-- Logs begin at Tue 2022-06-14 18:39:02 UTC, end at Tue 2022-06-14 20:02:40 UTC. -- Jun 14 19:33:21.274387 dv-cinder-845806-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 14 19:33:21.282964 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 14 19:33:21.286063 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 14 19:33:21 2022] *** Jun 14 19:33:21.286063 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 14 19:33:21.286063 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 14 19:33:21.286063 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: nodename: dv-cinder-845806-1-iscsi Jun 14 19:33:21.286063 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: machine: x86_64 Jun 14 19:33:21.286063 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: clock source: unix Jun 14 19:33:21.286063 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: pcre jit disabled Jun 14 19:33:21.286063 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: detected number of CPU cores: 4 Jun 14 19:33:21.286063 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: current working directory: / Jun 14 19:33:21.286063 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: detected binary path: /usr/bin/uwsgi-core Jun 14 19:33:21.286786 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: your processes number limit is 47680 Jun 14 19:33:21.286786 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: your memory page size is 4096 bytes Jun 14 19:33:21.286786 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: detected max file descriptor number: 2048 Jun 14 19:33:21.286786 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: lock engine: pthread robust mutexes Jun 14 19:33:21.286786 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: thunder lock: enabled Jun 14 19:33:21.286786 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 14 19:33:21.286786 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 14 19:33:21.332876 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: Python main interpreter initialized at 0x56118d63b9c0 Jun 14 19:33:21.332876 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: python threads support enabled Jun 14 19:33:21.332876 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: your server socket listen backlog is limited to 100 connections Jun 14 19:33:21.332876 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: your mercy for graceful operations on workers is 90 seconds Jun 14 19:33:21.333198 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: mapped 403077 bytes (393 KB) for 2 cores Jun 14 19:33:21.333358 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: *** Operational MODE: preforking *** Jun 14 19:33:21.333570 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: *** uWSGI is running in multiple interpreter mode *** Jun 14 19:33:21.333570 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: spawned uWSGI master process (pid: 109699) Jun 14 19:33:21.333760 dv-cinder-845806-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 14 19:33:21.334401 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: spawned uWSGI worker 1 (pid: 109700, cores: 1) Jun 14 19:33:21.334648 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: spawned uWSGI worker 2 (pid: 109701, cores: 1) Jun 14 19:33:21.334813 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 14 19:33:22.002410 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 14 19:33:22.004914 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 14 19:33:23.191007 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 19:33:23.191007 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: from cryptography.utils import int_from_bytes Jun 14 19:33:23.191749 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 19:33:23.191749 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: from cryptography.utils import int_from_bytes Jun 14 19:33:23.194348 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 19:33:23.194348 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: from cryptography.utils import int_from_bytes Jun 14 19:33:23.194813 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 19:33:23.194813 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: from cryptography.utils import int_from_bytes Jun 14 19:33:25.787790 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 19:33:25.788454 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 19:33:25.788544 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 19:33:25.788544 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 19:33:25.788953 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 19:33:25.788953 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 19:33:25.789077 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 19:33:25.789153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 19:33:25.789230 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 19:33:25.789511 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 19:33:25.789627 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.789853 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.789959 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.790176 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.790268 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.790499 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.790588 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.790813 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.790902 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.791131 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.791219 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.791438 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.791523 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.791755 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.791840 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.792071 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.792168 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.792330 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.792425 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.792640 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.792727 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.792951 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.793039 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845806-1-iscsi {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.793270 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.793362 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845806-1-iscsi {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.793602 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.793701 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.793913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.794015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.794230 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.794317 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.794536 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.794631 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.794838 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.794934 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.795158 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.795246 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.795465 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.795653 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.795964 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.796106 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.796272 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.796388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.796576 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.796691 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.796887 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.797010 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.797219 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.797354 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.797632 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.797737 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.797938 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.798024 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.798244 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.798347 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.798547 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.798633 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.798863 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.798944 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.799169 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.799264 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845806-1-iscsi {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.800070 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845806-1-iscsi {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.800214 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.800391 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.800511 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.800791 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.800949 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.801128 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.801314 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.801565 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.801659 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.801877 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.801977 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.802186 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.802274 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.802506 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.802604 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.802836 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.802937 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.803141 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.803236 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.803464 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.803565 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.803782 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.803877 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.804098 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.804195 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.804398 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.804484 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.804706 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.804797 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.805011 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.805097 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.805318 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.805450 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.805656 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.805754 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.805959 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.806044 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.806207 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.806302 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.806499 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.806586 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.806805 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.806903 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.807126 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.807227 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.807442 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.807530 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.807696 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.807828 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.807931 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.808032 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.808234 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.808340 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.808551 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.808661 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.808857 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.808951 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.809161 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.809253 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.809488 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.809597 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.809868 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.809962 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.810102 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.810190 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.810407 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.810507 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.810712 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.810811 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.811018 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.811107 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.811320 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.811496 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.811636 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.811723 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.811949 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.812038 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.812252 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.812352 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.812558 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.812646 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.812874 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.812972 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.813194 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.813282 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.813526 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.813626 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.813834 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.813933 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.814262 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.814344 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.814460 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.814582 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.814766 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.814868 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.815082 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.815178 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.815976 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.816090 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.816375 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.816476 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.816683 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.816824 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.816994 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.817128 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.819627 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.819792 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.819792 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.820054 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.820181 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.820304 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.820448 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.820573 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.820696 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.820826 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.820826 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.821061 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.821061 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.821303 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.821303 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.821568 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.821692 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.821815 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.821951 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.822077 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.822199 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.822322 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.822446 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.822583 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.822724 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.822848 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.822972 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.823055 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.823132 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.823218 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.823296 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.823372 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.823448 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.823523 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.823599 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.823692 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.823772 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.823848 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.823923 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.823999 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.824082 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.824169 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.824248 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.824324 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.824400 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.824482 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.824561 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.824659 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.824741 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.824832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.824919 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.824998 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.825075 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.825163 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.825242 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.825326 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.825501 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.825600 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.825821 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.825922 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.826125 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.826213 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.826429 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.826535 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.826740 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.826839 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.827042 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.827135 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.827346 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.827435 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.827645 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.827747 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.827947 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.828044 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.828251 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.828338 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.828554 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.828641 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.828856 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.828941 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.829156 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.829247 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.829474 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.829565 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.829777 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.829863 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.830077 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.830162 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.830378 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.830475 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.830677 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.830764 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.831123 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.831218 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.831522 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.831619 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.831813 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.831929 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.832126 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.832251 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.832439 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.832561 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.832747 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.832851 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.833069 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.833166 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.833429 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.833519 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:33:25.833766 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.833856 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.834108 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.834204 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.834424 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.834512 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.834756 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.834841 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.835085 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.835185 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.835403 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.835537 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.835715 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.835800 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.836027 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.836122 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.836336 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.836421 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.836649 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.836747 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.836959 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.837050 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.837268 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.837361 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.837599 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.837694 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.837915 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.838005 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.838231 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.838328 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.838539 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.838627 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.838851 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.838939 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.839163 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.839250 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.839472 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.839558 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.839779 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.839866 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.840092 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.840187 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.840408 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.840502 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.840722 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.840809 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.841030 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.841118 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.841368 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.841487 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.841712 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.841806 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.842019 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.842112 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.842341 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.842438 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.842650 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.842736 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.842955 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.843040 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.843262 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.843357 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.843569 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.843656 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.843885 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.843979 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.844195 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.844289 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.844512 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.844600 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.844822 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.844908 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.845129 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.845217 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.845458 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.845549 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.845767 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.845865 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.846076 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.846164 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.846382 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.846571 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.847123 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.847263 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.847438 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.847588 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.847754 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.847908 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.848074 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.848222 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.848389 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.848542 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.848703 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.848855 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.849017 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.849166 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.849323 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.849499 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.849656 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.849807 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.849963 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.850113 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.850273 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.850418 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.850579 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.850726 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.850904 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.851029 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.851230 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.851346 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.851537 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.851669 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.851869 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.851969 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.852176 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.852289 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.852487 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.852595 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.852798 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.852894 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.853108 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.853202 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.853434 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.853526 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.853750 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.853840 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.854060 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.854147 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.854366 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.854453 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.854680 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.854769 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.854990 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.855077 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.855298 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.855385 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.855599 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.855686 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.855916 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.856002 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.856219 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.856304 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.856523 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.856615 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.856833 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.856926 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.857140 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.857294 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.857468 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.857574 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.857779 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.857923 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.858091 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.858227 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.858403 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.858509 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.858713 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.858799 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.859023 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.859124 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.859354 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.859448 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.859659 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.859743 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.859973 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.860066 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.860294 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.860381 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.860610 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.860695 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.860923 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.861010 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.861224 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.861309 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.861553 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.861640 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.861861 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.861950 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.863040 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.863145 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.863225 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.863303 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.863464 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.863553 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.863771 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.863857 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.864073 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.864164 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.864377 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.864463 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.864679 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.864765 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.864982 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.865077 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.865296 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.865402 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.865631 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.865716 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.865933 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.866031 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.866236 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.866327 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.866536 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.866620 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.866874 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.866971 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.867178 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.867284 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.867523 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.867621 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.867843 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.867950 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.868163 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.868270 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.868472 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.868557 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.868782 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.868869 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.869094 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.869184 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.869416 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.869504 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.869731 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.869818 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.870039 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.870131 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.870354 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.870534 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.870691 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.870832 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.870970 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.871106 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.871258 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.871394 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.871564 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.871702 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.871881 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.872016 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.872188 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.872336 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.872498 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.872634 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.872800 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.872937 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.873112 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.873272 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.873471 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.873607 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.873792 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.873929 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.874106 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.874259 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.874418 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.874553 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.874725 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.874864 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.875034 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.875184 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.875338 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.875480 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.875639 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.875756 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.875946 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.876047 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.876255 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.876349 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.876566 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.876652 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.876871 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.876964 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.877184 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.877268 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.877512 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.877659 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.878437 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.878616 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.878688 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.878770 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.879076 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.879214 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.879381 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.879521 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.879695 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.879828 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.880019 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.880154 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.880334 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.880471 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.880644 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.880779 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.880954 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.881096 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.881268 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.881429 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.881601 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.881732 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.881912 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.882060 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.882219 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.882356 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.882520 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.882655 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.882824 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.882974 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.883132 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.883266 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.883442 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.883578 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.883748 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.883906 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.884052 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.884187 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.884346 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.884481 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.884652 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.884788 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.884957 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.885094 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.885263 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.885415 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.885589 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.885726 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.885900 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.886046 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.886220 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.886363 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.886513 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.886653 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.886828 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.886972 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.887145 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.887283 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.887432 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.887568 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.887735 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.887893 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.888052 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.888190 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.888339 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.888501 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.888662 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.888797 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.888938 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.889043 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.889238 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.889325 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.889600 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.889690 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.889907 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.890008 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.890211 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.890308 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.890524 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.890622 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.890834 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.890933 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.891139 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.891225 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.891450 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.891545 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.891758 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.891848 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.892062 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.892149 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.892380 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.892467 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.892688 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.892783 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.892993 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.893080 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.893326 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.893447 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.893657 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.893940 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.894045 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.894194 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.894290 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.894519 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.894617 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.894833 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.894921 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.895147 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.895243 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.895455 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.895543 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.895759 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.895847 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.896065 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.896158 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.896380 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.896475 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.896947 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.897034 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.897274 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.897367 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.897619 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.897708 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.897934 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.898021 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.898249 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.898337 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.898568 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.898656 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.898891 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.898978 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.899214 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.899314 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.899553 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.899650 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.899855 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.899952 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.900161 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.900247 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.900464 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.900549 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.900767 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.900855 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.901071 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.901166 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.901417 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.901513 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.901700 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.901790 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.902002 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.902091 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.902306 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.902392 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.902608 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.902702 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.902906 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.902999 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.903207 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.903308 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.903511 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.903629 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.903821 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.903918 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.904120 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.904227 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.904428 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.904523 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.904729 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.904822 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.905050 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.905161 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.905353 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.905463 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.905675 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.905771 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.905976 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.906076 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.906277 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.906363 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.906612 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.906698 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.907180 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.907272 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.907511 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.907596 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.907837 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.907923 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.908175 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.908261 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.908476 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.908563 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.908781 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.909534 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.910123 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.910225 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.910305 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.910383 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.910469 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.910563 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.910643 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.910721 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.910827 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.910912 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.911119 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.911296 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.911444 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.911586 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.911724 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.911862 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.912007 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.912163 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.912301 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.912440 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.912596 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.912734 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.912870 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.913015 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.913158 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.913302 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.913460 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.913548 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.913771 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.913861 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.914076 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.914162 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.914378 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.914467 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.914677 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.914765 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.914982 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.915069 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.915289 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.915382 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.915588 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.915676 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.915891 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.915977 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.916189 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.916289 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.916499 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.916596 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.916801 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.916888 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.917098 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.917194 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.917424 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.917530 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.917724 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.917811 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.918026 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.918123 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.918325 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.918414 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.918641 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.918736 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.918948 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.919049 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.919249 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.919336 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.919546 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.919632 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.919851 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.919954 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.920149 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.920235 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.920447 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.920533 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.920749 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.920836 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.921068 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.921204 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.921390 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.921481 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.921695 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.921785 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.922001 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.922088 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.922302 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.922395 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.922600 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.922688 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.922899 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.922999 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.923204 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.923298 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.923501 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.923588 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.923798 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.923884 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.924096 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.924192 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.924394 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.924488 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.925242 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.925396 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.925618 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.925769 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.925926 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.926090 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.926229 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.926402 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.926531 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.926712 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.926829 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.927019 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.927166 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.927364 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.927472 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.927675 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.927824 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.928034 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.928121 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.928344 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.928441 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.928660 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.928749 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.928981 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.929069 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.929294 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.929412 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.929632 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.929720 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.929934 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.930020 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.930239 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.930342 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.930543 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.930629 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.930851 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.930946 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.931153 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.931260 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.931452 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.931541 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.931758 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.931843 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.932065 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.932162 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.932371 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.932462 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.932679 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.932773 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.932998 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.933086 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.933316 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.933433 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.933655 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.933743 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.933956 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.934045 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.934262 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.934348 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.934567 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.934661 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.934872 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.934960 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.935180 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.935266 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.935485 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.935606 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.935790 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.935878 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.936097 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.936184 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.936404 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.936500 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.936714 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.936802 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.937019 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.937105 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.937325 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.937450 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.937663 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.937751 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.937966 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.938051 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.938268 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.938363 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.938583 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.938670 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.938884 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.938973 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.939186 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.939281 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.939486 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.939586 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.939789 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.939876 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.940090 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.940225 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.940514 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.940774 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.941095 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.941235 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.941429 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.941591 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.941735 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.941919 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.942047 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.942231 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.942341 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.942549 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.942645 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.942865 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.942959 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.943187 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.943282 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.943505 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.943649 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.943814 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.943959 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.944234 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.944321 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.944550 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.944643 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.944853 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.944937 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.945162 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.945256 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.945495 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.945586 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.945804 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.945890 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.946109 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.946197 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.946412 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.946497 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.946714 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.946799 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.947017 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.947103 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.947321 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.947407 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.947635 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.947728 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.947937 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.948030 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.948257 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.948343 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.948626 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.948718 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.948971 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.949055 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.949277 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.949368 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.949646 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.949743 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.949965 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.950065 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.950285 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.950388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.950604 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.950700 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.950908 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.951002 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.951217 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.951324 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.951528 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.951622 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.951847 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.951941 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.952156 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.952241 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.952462 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.952548 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.952774 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.952862 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.953077 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.953163 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.953413 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.953504 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.953736 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.953823 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.954046 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.954132 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.954364 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.954477 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.954697 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.954803 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.955019 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.955113 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.955383 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.955467 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.955701 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.955795 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.956078 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.956466 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.956549 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.956715 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.956806 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.956917 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.957004 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.957224 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.957310 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.957552 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.957648 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.957859 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.957946 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.958178 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.958266 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.958481 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.958569 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.958788 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.958877 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.959097 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.959189 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.959401 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.959487 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.959703 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.959795 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.960004 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.960098 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.960311 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.960414 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.960609 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.960703 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.960926 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.961019 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.961233 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.961319 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.961612 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.961799 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.961950 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.962104 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.962213 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.962345 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.962545 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.962664 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.962818 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.963684 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.964554 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.965641 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.966208 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.966208 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.966208 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.966463 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.966463 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.966632 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.966727 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.968060 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.968060 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.968284 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.968372 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.968372 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.968589 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.968812 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.969035 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.969267 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.969445 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.969534 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.969607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.969684 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.969838 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.970143 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.970236 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.970576 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.970729 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.970979 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.971087 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.971349 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.972032 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.972249 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.972425 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.972564 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.972744 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.972872 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.973060 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.973185 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.973410 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.973541 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.973717 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.973854 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.974031 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.974157 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.974349 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.974451 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.974661 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.974758 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.974992 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.975123 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.975300 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.975427 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.975730 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.975882 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.976000 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.976114 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.976256 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.976350 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.976541 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.976639 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.976851 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.976953 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.977180 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.977274 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.977537 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.977665 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.977845 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.977959 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.978179 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.978303 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.978500 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.978626 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.978824 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.978971 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.979137 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.979233 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.979452 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.979555 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.979778 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.979869 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.980096 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.980193 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.980430 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.980570 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.980727 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.980827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.981044 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.981137 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.981357 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.981464 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.981693 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.981803 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.982004 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.982098 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.982308 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.982402 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.982623 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.982760 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.982939 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.983027 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.983254 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.983473 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.983786 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.983881 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.984106 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.984199 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.984415 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.984513 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.984725 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.984821 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.985040 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.985134 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.985351 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.985462 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.985683 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.985781 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.985993 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.986099 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.986304 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.986405 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.986614 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.986702 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.986919 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.987043 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.987404 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.987510 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.987737 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.987844 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.988059 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.988153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.988379 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.988478 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.989205 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.989297 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.989544 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.989635 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.989862 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.989951 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.990176 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.990270 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.990527 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.990665 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.990833 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.990923 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.991132 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.991230 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.991446 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.991546 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.991759 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.991854 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.992072 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.992165 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.992382 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.992481 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.992724 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.992854 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.993001 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.993130 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.993311 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.993422 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.993644 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.993743 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.993954 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.994053 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.994268 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.994357 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.994584 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.994672 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.994913 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.995002 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.995233 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.995329 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.995550 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.995637 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.995863 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.995963 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.996174 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.996262 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.996491 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.996690 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.997005 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.997102 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.997318 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.997434 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.997673 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.997761 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.997999 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.998099 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.998318 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.998406 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.998633 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.998720 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.998947 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.999045 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.999255 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.999348 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.999562 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.999650 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.999864 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:25.999958 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.000171 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.000258 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.000475 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.000567 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.000780 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.000876 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.001091 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.001177 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.001416 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.001537 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.001724 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.001827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.002035 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.002130 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.002340 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.002566 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.002932 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.003344 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.003344 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.003476 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.003556 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.003736 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.003885 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.004067 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.004207 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.004397 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.004518 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.004716 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.004843 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.005032 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.005152 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.005359 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.005479 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.005689 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.005777 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.005999 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.006085 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.006316 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.006404 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.006632 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.006731 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.006938 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.007025 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.007246 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.007346 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.007557 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.007644 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.007865 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.007958 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.008166 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.008265 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.008477 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.008570 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.008782 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.008878 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.009088 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.009189 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.009421 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.009518 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.009731 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.009820 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.010034 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.010129 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.010339 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.010426 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.010644 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.010737 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.010949 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.011046 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.011252 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.011337 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.011556 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.011649 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.011865 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.011958 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.012170 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.012257 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.012476 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.012561 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.012779 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.012874 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.013088 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.013181 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.013406 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.013497 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.013717 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.013805 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.014064 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.014156 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.014372 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.014468 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.014673 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.014765 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.014983 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.015069 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.015297 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.015393 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.015604 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.015691 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.015915 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.016010 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.016224 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.016323 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.016534 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.016642 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.016878 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.017077 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.017189 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.017436 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.017741 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.017837 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.018073 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.018159 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.018508 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.018943 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.019030 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.019108 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.019259 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.019354 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.019571 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.019678 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.019874 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.019968 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.020179 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.020265 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.020500 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.020589 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.020809 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.020907 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.021118 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.021217 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.021452 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.021555 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.021761 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.021850 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.022069 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.022165 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.022378 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.022465 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.022688 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.022784 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.022998 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.023102 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.023307 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.023395 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.023615 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.023701 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.023923 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.024017 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.024228 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.024314 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.024536 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.024628 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.024850 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.024938 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.025176 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.025261 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.025519 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.025622 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.025837 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.025925 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.026149 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.026234 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.026463 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.026556 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.026771 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.026871 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.027081 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.027177 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.027386 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.027484 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.027695 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.027780 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.028009 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.028097 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.028313 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.028406 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.028636 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.028722 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.028940 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.029027 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.029343 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.029479 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.029689 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.029783 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.030002 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.030089 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.030326 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.030422 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.030650 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.030742 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.030961 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.031046 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.031278 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.031365 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.031587 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.031678 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.032170 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.032262 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.032481 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.032575 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.032807 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.032893 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.033136 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.033231 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.033468 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.033570 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.033778 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.033867 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.034683 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.035068 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.035174 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.035263 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.035352 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.035499 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.035601 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.035791 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.035888 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.036099 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.036193 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.036406 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.036502 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.036716 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.036804 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.037023 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.037217 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.037315 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.037424 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.037651 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.037752 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.038002 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.038095 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.038270 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.038371 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.038573 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.038660 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.038874 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.038962 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.039175 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.039268 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.039473 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.039558 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.039774 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.039859 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.040074 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.040174 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.040373 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.040459 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.040673 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.040767 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.040972 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.041058 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.041271 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.041357 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.041593 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.041681 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.041896 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.041984 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.042199 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.042293 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.042525 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.042612 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.042841 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.042928 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.043152 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.043245 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.043462 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.043562 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.043766 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.043852 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.044080 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.044179 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.044382 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.044480 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.044700 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.044797 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.045012 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.045097 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.045322 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.045460 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.045679 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.045766 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.045989 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.046076 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.046302 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.046400 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.046610 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.046703 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.046916 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.047002 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.047222 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.047311 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.047528 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.047629 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.047832 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.047919 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.048157 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.048257 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.048462 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.048547 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.048767 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.048858 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.049091 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.049177 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.049423 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.049589 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.050674 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.050864 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.050951 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.051018 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.051107 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.051187 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.051273 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.051360 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.051520 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.051610 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.051830 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.051916 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.052140 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.052235 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.052447 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.052533 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.052755 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.052856 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.053068 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.053157 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.053405 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.053494 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.053745 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.053831 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.054087 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.054185 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.054426 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.054555 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.054739 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.054836 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.055063 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.055150 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.055385 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.055470 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.055711 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.055797 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.056041 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.056127 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.056358 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.056452 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.056671 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.056764 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.056973 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.057072 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.057218 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 19:33:26.057307 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:33:26.057526 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109701) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 19:33:26.119580 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO dbcounter [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] Registered counter for database nova_api Jun 14 19:33:26.119764 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO dbcounter [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] Registered counter for database nova_api Jun 14 19:33:26.139588 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG oslo_db.sqlalchemy.engines [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109700) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:33:26.142537 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109701) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:33:26.146642 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG dbcounter [-] [109700] Writer thread running {{(pid=109700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:33:26.149393 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG dbcounter [-] [109701] Writer thread running {{(pid=109701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:33:26.205066 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.context [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f1fc354-1074-4113-b102-f8e074c62626(cell1) {{(pid=109700) load_cells /opt/stack/nova/nova/context.py:464}} Jun 14 19:33:26.208269 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.context [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f1fc354-1074-4113-b102-f8e074c62626(cell1) {{(pid=109701) load_cells /opt/stack/nova/nova/context.py:464}} Jun 14 19:33:26.209665 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG oslo_concurrency.lockutils [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:33:26.211261 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG oslo_concurrency.lockutils [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:33:26.212091 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG oslo_concurrency.lockutils [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:33:26.212437 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:33:26.214108 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG oslo_concurrency.lockutils [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109700) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:33:26.214206 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:33:26.214922 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:33:26.216086 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO dbcounter [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] Registered counter for database nova_cell0 Jun 14 19:33:26.216875 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:33:26.218859 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO dbcounter [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] Registered counter for database nova_cell0 Jun 14 19:33:26.220033 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO dbcounter [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] Registered counter for database nova_cell1 Jun 14 19:33:26.223217 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO dbcounter [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] Registered counter for database nova_cell1 Jun 14 19:33:26.228324 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG oslo_db.sqlalchemy.engines [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109700) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:33:26.229651 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG oslo_db.sqlalchemy.engines [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109700) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:33:26.231297 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109701) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:33:26.235133 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109701) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:33:26.236452 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG dbcounter [-] [109700] Writer thread running {{(pid=109700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:33:26.237856 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG dbcounter [-] [109701] Writer thread running {{(pid=109701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:33:26.239549 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG dbcounter [-] [109700] Writer thread running {{(pid=109700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:33:26.378976 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG dbcounter [-] [109701] Writer thread running {{(pid=109701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:33:26.387553 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO dbcounter [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] Registered counter for database nova_cell0 Jun 14 19:33:26.389456 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO dbcounter [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] Registered counter for database nova_cell0 Jun 14 19:33:26.396947 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109701) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:33:26.400544 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG oslo_db.sqlalchemy.engines [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109700) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:33:26.401505 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG dbcounter [-] [109701] Writer thread running {{(pid=109701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:33:26.404988 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG dbcounter [-] [109700] Writer thread running {{(pid=109700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:33:26.738864 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: WARNING keystonemiddleware.auth_token [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 19:33:26.742389 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: WARNING keystonemiddleware.auth_token [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 19:33:26.746216 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: WARNING keystonemiddleware.auth_token [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 19:33:26.749559 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: WARNING keystonemiddleware.auth_token [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 19:33:27.086505 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: WARNING keystonemiddleware.auth_token [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 19:33:27.092363 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: WARNING keystonemiddleware.auth_token [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 19:33:27.098302 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56118d63b9c0 pid: 109701 (default app) Jun 14 19:33:27.100375 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:33:27.101599 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001742 Jun 14 19:33:27.102012 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Tue Jun 14 19:33:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:33:27.103849 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: WARNING keystonemiddleware.auth_token [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 19:33:27.109799 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: WARNING keystonemiddleware.auth_token [None req-2ded299d-1bff-49c4-8e0a-826b1cd0fc78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 19:33:27.115339 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56118d63b9c0 pid: 109700 (default app) Jun 14 19:34:43.715723 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:34:43.716644 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 14 19:34:43.717247 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 14 19:34:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:34:43.729676 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG dbcounter [-] [109700] Writing DB stats nova_api:SELECT=3 {{(pid=109700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:43.730680 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG dbcounter [-] [109700] Writing DB stats nova_cell1:SELECT=3 {{(pid=109700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:43.731850 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG dbcounter [-] [109700] Writing DB stats nova_cell0:SELECT=3 {{(pid=109700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:43.733677 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG dbcounter [-] [109700] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:44.177695 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-add7e8b6-6daf-4795-834d-89db85fc3569 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:34:44.209543 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-add7e8b6-6daf-4795-834d-89db85fc3569 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.485227 Jun 14 19:34:44.210271 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1291 bytes} [Tue Jun 14 19:34:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:34:46.407380 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:34:46.409147 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-d2e0c35f-ebb1-43c9-82a6-28ba2a0fa78c None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002358 Jun 14 19:34:46.409615 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 14 19:34:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:34:46.481305 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-0d389654-847b-47e1-8b92-6ac429ae32c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:34:46.500139 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:34:46.500139 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: warnings.warn(msg) Jun 14 19:34:46.528493 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-0d389654-847b-47e1-8b92-6ac429ae32c9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.112023 Jun 14 19:34:46.529040 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 14 19:34:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:34:46.542714 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG dbcounter [-] [109701] Writing DB stats nova_api:SELECT=3 {{(pid=109701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:46.543903 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG dbcounter [-] [109701] Writing DB stats nova_cell0:SELECT=3 {{(pid=109701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:46.545820 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG dbcounter [-] [109701] Writing DB stats nova_cell1:SELECT=3 {{(pid=109701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:46.546599 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG dbcounter [-] [109701] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:46.752607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-73f21eac-7568-4ce5-bf59-73a303f13a08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:34:46.755091 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:34:46.755091 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: warnings.warn(msg) Jun 14 19:34:46.825682 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-73f21eac-7568-4ce5-bf59-73a303f13a08 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288170 Jun 14 19:34:46.827123 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1335 bytes} [Tue Jun 14 19:34:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:34:49.071031 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-0d389654-847b-47e1-8b92-6ac429ae32c9 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:34:49.072237 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-0d389654-847b-47e1-8b92-6ac429ae32c9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Jun 14 19:34:49.072641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 14 19:34:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:34:49.184812 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-c9e80437-02d3-49eb-b950-08ebd42002f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:34:49.217556 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:34:49.217556 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: warnings.warn(msg) Jun 14 19:34:49.243914 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-c9e80437-02d3-49eb-b950-08ebd42002f2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.165018 Jun 14 19:34:49.244401 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 14 19:34:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 19:34:49.256580 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-12c55265-4991-40bd-9e07-16007bae19bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:34:49.258247 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:34:49.258247 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: warnings.warn(msg) Jun 14 19:34:49.291688 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-12c55265-4991-40bd-9e07-16007bae19bb admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038871 Jun 14 19:34:49.292357 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1335 bytes} [Tue Jun 14 19:34:49 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:34:51.475356 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-c9e80437-02d3-49eb-b950-08ebd42002f2 admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:34:51.476375 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-c9e80437-02d3-49eb-b950-08ebd42002f2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 14 19:34:51.476769 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 14 19:34:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:34:51.536645 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-fdc9b783-ca99-4dba-aca5-10585ef997bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "swap": 0, "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024}} {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:34:51.554860 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-fdc9b783-ca99-4dba-aca5-10585ef997bf admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072111 Jun 14 19:34:51.555596 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 14 19:34:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:34:51.568284 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-0034a22c-0ad1-42a7-839c-735299d2348e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:34:51.597774 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-0034a22c-0ad1-42a7-839c-735299d2348e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033260 Jun 14 19:34:51.598748 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1335 bytes} [Tue Jun 14 19:34:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:34:53.773961 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-fdc9b783-ca99-4dba-aca5-10585ef997bf admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:34:53.775006 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-fdc9b783-ca99-4dba-aca5-10585ef997bf admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 14 19:34:53.775404 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 14 19:34:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:34:53.836417 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-1c679a49-5756-4f2d-85ae-2cd41ea6bd04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "swap": 0, "vcpus": 2, "disk": 10, "name": "ds2G", "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:34:53.860287 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-1c679a49-5756-4f2d-85ae-2cd41ea6bd04 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078151 Jun 14 19:34:53.860881 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 14 19:34:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:34:53.873412 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-62d9642e-648f-46b3-af61-744824ba97c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:34:53.898118 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-62d9642e-648f-46b3-af61-744824ba97c6 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028677 Jun 14 19:34:53.898700 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1335 bytes} [Tue Jun 14 19:34:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:34:56.100568 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-1c679a49-5756-4f2d-85ae-2cd41ea6bd04 admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:34:56.101618 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-1c679a49-5756-4f2d-85ae-2cd41ea6bd04 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 14 19:34:56.102019 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 14 19:34:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:34:56.166932 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-944bc833-34d1-4fc6-9593-6d4306db52b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4, "id": "d4", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:34:56.187137 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-944bc833-34d1-4fc6-9593-6d4306db52b0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078434 Jun 14 19:34:56.195198 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 14 19:34:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:34:56.200034 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-48d4bd16-2ba2-474d-947e-7f99d93ba5c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:34:56.226524 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-48d4bd16-2ba2-474d-947e-7f99d93ba5c0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029691 Jun 14 19:34:56.231417 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1335 bytes} [Tue Jun 14 19:34:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:34:58.573708 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-944bc833-34d1-4fc6-9593-6d4306db52b0 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:34:58.574741 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-944bc833-34d1-4fc6-9593-6d4306db52b0 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 14 19:34:58.575303 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 14 19:34:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:34:58.640989 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-149562b3-ee14-42d5-8b6c-8b404d0ecb23 admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:34:58.664168 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-149562b3-ee14-42d5-8b6c-8b404d0ecb23 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082539 Jun 14 19:34:58.664702 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1291 bytes} [Tue Jun 14 19:34:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:35:01.025463 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-944bc833-34d1-4fc6-9593-6d4306db52b0 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:01.026750 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-944bc833-34d1-4fc6-9593-6d4306db52b0 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Jun 14 19:35:01.027246 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 14 19:35:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:35:01.093222 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-ebcb1373-df54-4c20-840a-6dae2701d91e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:35:01.113225 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-ebcb1373-df54-4c20-840a-6dae2701d91e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077885 Jun 14 19:35:01.114236 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 14 19:35:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:35:01.127136 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-8952c106-31c7-482b-a53c-b187596f8979 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:35:01.152706 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-8952c106-31c7-482b-a53c-b187596f8979 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029225 Jun 14 19:35:01.153722 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1332 bytes} [Tue Jun 14 19:35:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:35:03.429015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-ebcb1373-df54-4c20-840a-6dae2701d91e admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:03.430382 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-ebcb1373-df54-4c20-840a-6dae2701d91e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001904 Jun 14 19:35:03.430927 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 14 19:35:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:35:03.494764 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-db8c48c4-197b-4b95-ad71-c9d616477f37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 20, "ram": 2048, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:35:03.513599 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-db8c48c4-197b-4b95-ad71-c9d616477f37 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076127 Jun 14 19:35:03.514767 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 14 19:35:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 19:35:03.528332 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-52f92c9f-1bd7-4383-91cb-76e5221a0677 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:35:03.555968 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-52f92c9f-1bd7-4383-91cb-76e5221a0677 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032426 Jun 14 19:35:03.556976 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1332 bytes} [Tue Jun 14 19:35:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:35:05.877966 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-db8c48c4-197b-4b95-ad71-c9d616477f37 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:05.878988 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-db8c48c4-197b-4b95-ad71-c9d616477f37 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jun 14 19:35:05.879393 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 14 19:35:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:35:05.942769 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-ba2ec0b6-8557-44e7-a0b8-0fd719c0aaf5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "ram": 4096, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:35:05.959964 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-ba2ec0b6-8557-44e7-a0b8-0fd719c0aaf5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074419 Jun 14 19:35:05.960499 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 14 19:35:05 2022] POST /compute/v2.1/flavors => generated 406 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 19:35:05.972766 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-d24bba8e-90d7-450e-8eff-5f95ab4faa03 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:35:05.995417 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-d24bba8e-90d7-450e-8eff-5f95ab4faa03 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026246 Jun 14 19:35:05.996003 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1332 bytes} [Tue Jun 14 19:35:05 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:35:08.181153 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-ba2ec0b6-8557-44e7-a0b8-0fd719c0aaf5 admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:08.182542 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-ba2ec0b6-8557-44e7-a0b8-0fd719c0aaf5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001935 Jun 14 19:35:08.183134 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 14 19:35:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:35:08.252353 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-e6e1e93e-590f-494a-81b7-4ca63056ff31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "ram": 8192, "name": "m1.large", "disk": 80, "id": "4"}} {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:35:08.272842 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-e6e1e93e-590f-494a-81b7-4ca63056ff31 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082717 Jun 14 19:35:08.273480 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 14 19:35:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:35:08.287231 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-3b258616-5f17-4fb9-9eda-563f0644116b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:35:08.312149 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-3b258616-5f17-4fb9-9eda-563f0644116b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029127 Jun 14 19:35:08.312941 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1332 bytes} [Tue Jun 14 19:35:08 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:35:10.513676 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-e6e1e93e-590f-494a-81b7-4ca63056ff31 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:10.515291 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-e6e1e93e-590f-494a-81b7-4ca63056ff31 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002073 Jun 14 19:35:10.515694 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 14 19:35:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:35:10.577807 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-3c451f7d-cc0d-48ba-ad8b-e6d10c082934 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "name": "m1.xlarge", "vcpus": 8}} {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:35:10.597226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-3c451f7d-cc0d-48ba-ad8b-e6d10c082934 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075461 Jun 14 19:35:10.598183 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 14 19:35:10 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 19:35:10.612123 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-457e853c-26ae-42ac-8eda-b5ecec793db5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:35:10.635388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-457e853c-26ae-42ac-8eda-b5ecec793db5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028403 Jun 14 19:35:10.636067 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1332 bytes} [Tue Jun 14 19:35:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:35:34.382918 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-3c451f7d-cc0d-48ba-ad8b-e6d10c082934 admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:34.383926 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-3c451f7d-cc0d-48ba-ad8b-e6d10c082934 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 14 19:35:34.384321 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 14 19:35:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:35:34.394963 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG dbcounter [-] [109700] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:35:34.444846 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-f2047643-e721-482c-a83f-8e5a75cf61c6 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:34.461455 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-f2047643-e721-482c-a83f-8e5a75cf61c6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071024 Jun 14 19:35:34.461971 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1291 bytes} [Tue Jun 14 19:35:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:35:35.428284 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-3c451f7d-cc0d-48ba-ad8b-e6d10c082934 admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:35.429282 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-3c451f7d-cc0d-48ba-ad8b-e6d10c082934 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 14 19:35:35.429856 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 14 19:35:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:35:35.618251 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-0c35aad1-d94f-4a8b-8b8e-d322693c99a2 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:35.624637 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.wsgi [None req-0c35aad1-d94f-4a8b-8b8e-d322693c99a2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-0c35aad1-d94f-4a8b-8b8e-d322693c99a2 admin admin] Request method failure captured: Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Accept: application/json Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Accept-Encoding: gzip, deflate Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Connection: keep-alive Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Content-Length: 0 Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Host: 10.222.0.44 Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Openstack-Api-Version: compute 2.90 Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Openstack-System-Scope: None Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: User-Agent: python-novaclient Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Auth-Token: gAAAAABiqOMHaKN9i4eO21AJd0r27JK1bSupvoN45DWt7QT_YJOmG6eRUkjnV2xurQ2R5vfWISVgPRrTBcIO24_xAqQRl42R_ZQvlEvcCrDwEHXQ1Vu30rxJucFrpJt4jN81FxzqBlObKyhxUurERFOEiixTHUWWV8HrrIPfDkEbdLEvwynjraY Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Domain-Id: None Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Domain-Name: None Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Identity-Status: Confirmed Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Is-Admin-Project: True Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Project-Domain-Id: default Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Project-Domain-Name: Default Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Project-Id: 782dbf52581f4a55b95487f939e373c1 Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Project-Name: admin Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Role: member,reader,admin Jun 14 19:35:35.628153 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Roles: member,reader,admin Jun 14 19:35:35.629838 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782dbf52581f4a55b95487f939e373c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_782dbf52581f4a55b95487f939e373c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/782dbf52581f4a55b95487f939e373c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782dbf52581f4a55b95487f939e373c1"}]}] Jun 14 19:35:35.629838 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Tenant: admin Jun 14 19:35:35.629838 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Tenant-Id: 782dbf52581f4a55b95487f939e373c1 Jun 14 19:35:35.629838 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Tenant-Name: admin Jun 14 19:35:35.629838 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-User: admin Jun 14 19:35:35.629838 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-User-Domain-Id: default Jun 14 19:35:35.629838 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-User-Domain-Name: Default Jun 14 19:35:35.629838 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-User-Id: 13cde894f1744031872e9c62485bd552 Jun 14 19:35:35.629838 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-User-Name: admin Jun 14 19:35:35.629838 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: method: > Jun 14 19:35:35.629838 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: exception: Flavor 42 could not be found. Jun 14 19:35:35.629838 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: action_args: {'id': '42'} Jun 14 19:35:35.629838 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:35:35.629838 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:35:35.630832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Jun 14 19:35:35.632205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-0c35aad1-d94f-4a8b-8b8e-d322693c99a2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:35:35.633595 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-0c35aad1-d94f-4a8b-8b8e-d322693c99a2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062734 Jun 14 19:35:35.633595 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Jun 14 19:35:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:35.639990 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-a2493285-3bbc-4eff-9ede-6cc9fee85012 admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:35.643163 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG dbcounter [-] [109701] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:35:35.663047 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-a2493285-3bbc-4eff-9ede-6cc9fee85012 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027353 Jun 14 19:35:35.663763 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jun 14 19:35:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:35:35.673183 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-e9d5fb0d-ef7f-4396-adaa-f412da2a460c admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:35.694317 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-e9d5fb0d-ef7f-4396-adaa-f412da2a460c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024704 Jun 14 19:35:35.694837 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jun 14 19:35:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:35:35.704592 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-5738006e-04f5-44a7-b7d7-5ee76b1ce057 admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:35.710824 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.wsgi [None req-5738006e-04f5-44a7-b7d7-5ee76b1ce057 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-5738006e-04f5-44a7-b7d7-5ee76b1ce057 admin admin] Request method failure captured: Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Accept: application/json Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Accept-Encoding: gzip, deflate Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Connection: keep-alive Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Content-Length: 0 Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Host: 10.222.0.44 Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Openstack-Api-Version: compute 2.90 Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Openstack-System-Scope: None Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: User-Agent: python-novaclient Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Auth-Token: gAAAAABiqOMHaKN9i4eO21AJd0r27JK1bSupvoN45DWt7QT_YJOmG6eRUkjnV2xurQ2R5vfWISVgPRrTBcIO24_xAqQRl42R_ZQvlEvcCrDwEHXQ1Vu30rxJucFrpJt4jN81FxzqBlObKyhxUurERFOEiixTHUWWV8HrrIPfDkEbdLEvwynjraY Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Domain-Id: None Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Domain-Name: None Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Identity-Status: Confirmed Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Is-Admin-Project: True Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Project-Domain-Id: default Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Project-Domain-Name: Default Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Project-Id: 782dbf52581f4a55b95487f939e373c1 Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Project-Name: admin Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Role: member,reader,admin Jun 14 19:35:35.714066 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Roles: member,reader,admin Jun 14 19:35:35.715671 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782dbf52581f4a55b95487f939e373c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_782dbf52581f4a55b95487f939e373c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/782dbf52581f4a55b95487f939e373c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782dbf52581f4a55b95487f939e373c1"}]}] Jun 14 19:35:35.715671 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Tenant: admin Jun 14 19:35:35.715671 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Tenant-Id: 782dbf52581f4a55b95487f939e373c1 Jun 14 19:35:35.715671 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Tenant-Name: admin Jun 14 19:35:35.715671 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-User: admin Jun 14 19:35:35.715671 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-User-Domain-Id: default Jun 14 19:35:35.715671 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-User-Domain-Name: Default Jun 14 19:35:35.715671 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-User-Id: 13cde894f1744031872e9c62485bd552 Jun 14 19:35:35.715671 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-User-Name: admin Jun 14 19:35:35.715671 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: method: > Jun 14 19:35:35.715671 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: exception: Flavor 42 could not be found. Jun 14 19:35:35.715671 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: action_args: {'id': '42'} Jun 14 19:35:35.715671 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:35:35.715671 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:35:35.716663 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Jun 14 19:35:35.718000 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-5738006e-04f5-44a7-b7d7-5ee76b1ce057 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:35:35.719160 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-5738006e-04f5-44a7-b7d7-5ee76b1ce057 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015046 Jun 14 19:35:35.719160 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Jun 14 19:35:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:36.584870 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-e9d5fb0d-ef7f-4396-adaa-f412da2a460c admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:36.585906 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-e9d5fb0d-ef7f-4396-adaa-f412da2a460c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 14 19:35:36.586292 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 14 19:35:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:35:36.784967 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-51f043ef-2405-40c5-97ec-4f7a9fcae5fa admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:36.790836 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.wsgi [None req-51f043ef-2405-40c5-97ec-4f7a9fcae5fa admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-51f043ef-2405-40c5-97ec-4f7a9fcae5fa admin admin] Request method failure captured: Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Accept: application/json Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Accept-Encoding: gzip, deflate Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Connection: keep-alive Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Content-Length: 0 Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Host: 10.222.0.44 Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Openstack-Api-Version: compute 2.90 Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Openstack-System-Scope: None Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: User-Agent: python-novaclient Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Auth-Token: gAAAAABiqOMIbaLf_SZhLQU_Of1Nbl05fCxtIaHJyCfil7Smyz5LTCS5zmnQ0NRrWImP5QgR4LQgTNNfLDjfDi6unR88Tvyl1qmgjmRWTzZ7WTjk66wlE5soPTyIAwaAwNrLmycf_ND3jHWpGRuGe152S3UgdG4HMc1WlnICOGOey8MnGRoQ1_M Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Domain-Id: None Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Domain-Name: None Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Identity-Status: Confirmed Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Is-Admin-Project: True Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Project-Domain-Id: default Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Project-Domain-Name: Default Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Project-Id: 782dbf52581f4a55b95487f939e373c1 Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Project-Name: admin Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Role: member,reader,admin Jun 14 19:35:36.792358 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Roles: member,reader,admin Jun 14 19:35:36.793942 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782dbf52581f4a55b95487f939e373c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_782dbf52581f4a55b95487f939e373c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/782dbf52581f4a55b95487f939e373c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782dbf52581f4a55b95487f939e373c1"}]}] Jun 14 19:35:36.793942 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Tenant: admin Jun 14 19:35:36.793942 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Tenant-Id: 782dbf52581f4a55b95487f939e373c1 Jun 14 19:35:36.793942 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Tenant-Name: admin Jun 14 19:35:36.793942 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-User: admin Jun 14 19:35:36.793942 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-User-Domain-Id: default Jun 14 19:35:36.793942 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-User-Domain-Name: Default Jun 14 19:35:36.793942 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-User-Id: 13cde894f1744031872e9c62485bd552 Jun 14 19:35:36.793942 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-User-Name: admin Jun 14 19:35:36.793942 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: method: > Jun 14 19:35:36.793942 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: exception: Flavor 84 could not be found. Jun 14 19:35:36.793942 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: action_args: {'id': '84'} Jun 14 19:35:36.793942 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:35:36.793942 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:35:36.794815 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Jun 14 19:35:36.796015 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-51f043ef-2405-40c5-97ec-4f7a9fcae5fa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:35:36.797036 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-51f043ef-2405-40c5-97ec-4f7a9fcae5fa admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064340 Jun 14 19:35:36.797036 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Jun 14 19:35:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:36.803349 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-534f1b6a-e3fb-419d-9990-bcc92496b72b admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:36.818851 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-534f1b6a-e3fb-419d-9990-bcc92496b72b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019046 Jun 14 19:35:36.819396 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jun 14 19:35:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:35:36.829508 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-3b38e14b-f3c9-47d1-9eae-5595c75b4cfc admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:36.845337 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-3b38e14b-f3c9-47d1-9eae-5595c75b4cfc admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019996 Jun 14 19:35:36.845875 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jun 14 19:35:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:35:36.855029 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-2b92249e-5eb1-4d7e-a51f-f4bd7a152b46 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:36.860373 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.wsgi [None req-2b92249e-5eb1-4d7e-a51f-f4bd7a152b46 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-2b92249e-5eb1-4d7e-a51f-f4bd7a152b46 admin admin] Request method failure captured: Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Accept: application/json Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Accept-Encoding: gzip, deflate Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Connection: keep-alive Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Content-Length: 0 Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Host: 10.222.0.44 Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Openstack-Api-Version: compute 2.90 Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Openstack-System-Scope: None Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: User-Agent: python-novaclient Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Auth-Token: gAAAAABiqOMIbaLf_SZhLQU_Of1Nbl05fCxtIaHJyCfil7Smyz5LTCS5zmnQ0NRrWImP5QgR4LQgTNNfLDjfDi6unR88Tvyl1qmgjmRWTzZ7WTjk66wlE5soPTyIAwaAwNrLmycf_ND3jHWpGRuGe152S3UgdG4HMc1WlnICOGOey8MnGRoQ1_M Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Domain-Id: None Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Domain-Name: None Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Identity-Status: Confirmed Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Is-Admin-Project: True Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Project-Domain-Id: default Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Project-Domain-Name: Default Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Project-Id: 782dbf52581f4a55b95487f939e373c1 Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Project-Name: admin Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Role: member,reader,admin Jun 14 19:35:36.861913 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Roles: member,reader,admin Jun 14 19:35:36.863471 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782dbf52581f4a55b95487f939e373c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_782dbf52581f4a55b95487f939e373c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/782dbf52581f4a55b95487f939e373c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782dbf52581f4a55b95487f939e373c1"}]}] Jun 14 19:35:36.863471 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Tenant: admin Jun 14 19:35:36.863471 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Tenant-Id: 782dbf52581f4a55b95487f939e373c1 Jun 14 19:35:36.863471 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Tenant-Name: admin Jun 14 19:35:36.863471 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-User: admin Jun 14 19:35:36.863471 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-User-Domain-Id: default Jun 14 19:35:36.863471 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-User-Domain-Name: Default Jun 14 19:35:36.863471 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-User-Id: 13cde894f1744031872e9c62485bd552 Jun 14 19:35:36.863471 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-User-Name: admin Jun 14 19:35:36.863471 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: method: > Jun 14 19:35:36.863471 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: exception: Flavor 84 could not be found. Jun 14 19:35:36.863471 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: action_args: {'id': '84'} Jun 14 19:35:36.863471 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:35:36.863471 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:35:36.864368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Jun 14 19:35:36.865641 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-2b92249e-5eb1-4d7e-a51f-f4bd7a152b46 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:35:36.866856 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-2b92249e-5eb1-4d7e-a51f-f4bd7a152b46 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011761 Jun 14 19:35:36.866856 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Jun 14 19:35:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 14 19:35:37.729864 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-3b38e14b-f3c9-47d1-9eae-5595c75b4cfc admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:37.730868 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-3b38e14b-f3c9-47d1-9eae-5595c75b4cfc admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 14 19:35:37.731260 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 14 19:35:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:35:37.921094 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-dc76177e-ec1a-43cf-9e00-19b5658fce38 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:37.926856 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.wsgi [None req-dc76177e-ec1a-43cf-9e00-19b5658fce38 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-dc76177e-ec1a-43cf-9e00-19b5658fce38 admin admin] Request method failure captured: Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Accept: application/json Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Accept-Encoding: gzip, deflate Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Connection: keep-alive Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Content-Length: 0 Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Host: 10.222.0.44 Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Openstack-Api-Version: compute 2.90 Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Openstack-System-Scope: None Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: User-Agent: python-novaclient Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Auth-Token: gAAAAABiqOMJA42uNrtRKSiZWG3s5MKUzKhMFYNPacjMrYdvO-FEjSIqcKAem6UIp1OcT9Qr9cDzWiMWzVT9xcNQkg11TpLw-SGivYGAuWBKaLoAGPfAr-8pQbWwRYnQanLC5hdMGGj1P87W85VFrgd1FRUishvuTKnn1FGiDE9hsEoNlA5Cw2k Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Domain-Id: None Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Domain-Name: None Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Identity-Status: Confirmed Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Is-Admin-Project: True Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Project-Domain-Id: default Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Project-Domain-Name: Default Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Project-Id: 782dbf52581f4a55b95487f939e373c1 Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Project-Name: admin Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Role: member,reader,admin Jun 14 19:35:37.928388 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Roles: member,reader,admin Jun 14 19:35:37.929897 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782dbf52581f4a55b95487f939e373c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_782dbf52581f4a55b95487f939e373c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/782dbf52581f4a55b95487f939e373c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782dbf52581f4a55b95487f939e373c1"}]}] Jun 14 19:35:37.929897 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Tenant: admin Jun 14 19:35:37.929897 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Tenant-Id: 782dbf52581f4a55b95487f939e373c1 Jun 14 19:35:37.929897 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-Tenant-Name: admin Jun 14 19:35:37.929897 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-User: admin Jun 14 19:35:37.929897 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-User-Domain-Id: default Jun 14 19:35:37.929897 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-User-Domain-Name: Default Jun 14 19:35:37.929897 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-User-Id: 13cde894f1744031872e9c62485bd552 Jun 14 19:35:37.929897 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: X-User-Name: admin Jun 14 19:35:37.929897 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: method: > Jun 14 19:35:37.929897 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: exception: Flavor 451 could not be found. Jun 14 19:35:37.929897 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: action_args: {'id': '451'} Jun 14 19:35:37.929897 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:35:37.929897 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:35:37.930827 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: ERROR nova.api.openstack.wsgi Jun 14 19:35:37.932089 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-dc76177e-ec1a-43cf-9e00-19b5658fce38 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109700) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:35:37.933308 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-dc76177e-ec1a-43cf-9e00-19b5658fce38 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060288 Jun 14 19:35:37.933308 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jun 14 19:35:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:37.939392 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-f57388af-c8d6-406f-aa24-8cc8e777c400 admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:37.952873 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-f57388af-c8d6-406f-aa24-8cc8e777c400 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017123 Jun 14 19:35:37.953331 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jun 14 19:35:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:35:37.962355 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-a98ac1e2-2868-470c-ba30-f791ef0ac047 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:37.976451 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-a98ac1e2-2868-470c-ba30-f791ef0ac047 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017584 Jun 14 19:35:37.976965 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jun 14 19:35:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:35:37.986483 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-1410557a-f24b-4255-9cf1-f2ffb2e36216 admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:37.991719 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.wsgi [None req-1410557a-f24b-4255-9cf1-f2ffb2e36216 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-1410557a-f24b-4255-9cf1-f2ffb2e36216 admin admin] Request method failure captured: Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Accept: application/json Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Accept-Encoding: gzip, deflate Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Connection: keep-alive Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Content-Length: 0 Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Host: 10.222.0.44 Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Openstack-Api-Version: compute 2.90 Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Openstack-System-Scope: None Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: User-Agent: python-novaclient Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Auth-Token: gAAAAABiqOMJA42uNrtRKSiZWG3s5MKUzKhMFYNPacjMrYdvO-FEjSIqcKAem6UIp1OcT9Qr9cDzWiMWzVT9xcNQkg11TpLw-SGivYGAuWBKaLoAGPfAr-8pQbWwRYnQanLC5hdMGGj1P87W85VFrgd1FRUishvuTKnn1FGiDE9hsEoNlA5Cw2k Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Domain-Id: None Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Domain-Name: None Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Identity-Status: Confirmed Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Is-Admin-Project: True Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Project-Domain-Id: default Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Project-Domain-Name: Default Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Project-Id: 782dbf52581f4a55b95487f939e373c1 Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Project-Name: admin Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Role: member,reader,admin Jun 14 19:35:37.993226 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Roles: member,reader,admin Jun 14 19:35:37.994772 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782dbf52581f4a55b95487f939e373c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_782dbf52581f4a55b95487f939e373c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/782dbf52581f4a55b95487f939e373c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/782dbf52581f4a55b95487f939e373c1"}]}] Jun 14 19:35:37.994772 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Tenant: admin Jun 14 19:35:37.994772 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Tenant-Id: 782dbf52581f4a55b95487f939e373c1 Jun 14 19:35:37.994772 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-Tenant-Name: admin Jun 14 19:35:37.994772 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-User: admin Jun 14 19:35:37.994772 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-User-Domain-Id: default Jun 14 19:35:37.994772 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-User-Domain-Name: Default Jun 14 19:35:37.994772 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-User-Id: 13cde894f1744031872e9c62485bd552 Jun 14 19:35:37.994772 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: X-User-Name: admin Jun 14 19:35:37.994772 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: method: > Jun 14 19:35:37.994772 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: exception: Flavor 451 could not be found. Jun 14 19:35:37.994772 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: action_args: {'id': '451'} Jun 14 19:35:37.994772 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:35:37.994772 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:35:37.995607 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: ERROR nova.api.openstack.wsgi Jun 14 19:35:37.996620 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-1410557a-f24b-4255-9cf1-f2ffb2e36216 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109701) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:35:37.997790 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-1410557a-f24b-4255-9cf1-f2ffb2e36216 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012193 Jun 14 19:35:37.997790 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jun 14 19:35:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:38.861563 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-a98ac1e2-2868-470c-ba30-f791ef0ac047 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:38.862583 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-a98ac1e2-2868-470c-ba30-f791ef0ac047 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jun 14 19:35:38.862979 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 14 19:35:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:35:39.052911 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-ebad9a57-db02-4d11-aa4a-3fd15f272da5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:35:39.071896 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-ebad9a57-db02-4d11-aa4a-3fd15f272da5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070208 Jun 14 19:35:39.072436 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Jun 14 19:35:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:35:39.937399 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-a98ac1e2-2868-470c-ba30-f791ef0ac047 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:39.938413 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-a98ac1e2-2868-470c-ba30-f791ef0ac047 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002128 Jun 14 19:35:39.938805 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 14 19:35:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:35:40.128564 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-ce081ae4-e2d3-47c6-ab91-925f58677bd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:35:40.146333 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-ce081ae4-e2d3-47c6-ab91-925f58677bd3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068371 Jun 14 19:35:40.146865 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Jun 14 19:35:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:35:41.006878 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-a98ac1e2-2868-470c-ba30-f791ef0ac047 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:41.007885 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-a98ac1e2-2868-470c-ba30-f791ef0ac047 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 14 19:35:41.008276 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 14 19:35:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:35:41.199327 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-7611e28b-36c1-4960-a9a5-f37987ade7d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:35:41.216718 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-7611e28b-36c1-4960-a9a5-f37987ade7d3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068789 Jun 14 19:35:41.217833 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Jun 14 19:35:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:35:42.084072 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-a98ac1e2-2868-470c-ba30-f791ef0ac047 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:42.085068 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-a98ac1e2-2868-470c-ba30-f791ef0ac047 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jun 14 19:35:42.085496 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 14 19:35:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:35:42.277034 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-4694af6d-aa77-4141-a57b-2b68e96037dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:35:42.294624 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-4694af6d-aa77-4141-a57b-2b68e96037dc admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068745 Jun 14 19:35:42.295159 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Jun 14 19:35:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 19:35:43.159975 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-a98ac1e2-2868-470c-ba30-f791ef0ac047 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:43.161013 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-a98ac1e2-2868-470c-ba30-f791ef0ac047 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 14 19:35:43.161437 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 14 19:35:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:35:43.349575 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-fa4ee623-e042-4771-9a2e-b3125c385be4 admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:35:43.369360 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-fa4ee623-e042-4771-9a2e-b3125c385be4 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070240 Jun 14 19:35:43.369847 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Tue Jun 14 19:35:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:36:31.504750 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-a98ac1e2-2868-470c-ba30-f791ef0ac047 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:36:31.505795 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-a98ac1e2-2868-470c-ba30-f791ef0ac047 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 14 19:36:31.506205 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 14 19:36:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:36:31.518372 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG dbcounter [-] [109701] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:36:31.568857 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-563c6e71-dadf-4fd2-af73-929e3f5c5120 admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:36:31.588935 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-563c6e71-dadf-4fd2-af73-929e3f5c5120 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076524 Jun 14 19:36:31.589544 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1291 bytes} [Tue Jun 14 19:36:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:36:31.618146 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-91604f3b-4d7b-45a0-9dcf-b1c074e5ad9a admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:36:31.621599 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG dbcounter [-] [109700] Writing DB stats nova_api:SELECT=14 {{(pid=109700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:36:31.628276 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-91604f3b-4d7b-45a0-9dcf-b1c074e5ad9a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013721 Jun 14 19:36:31.628832 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1282 bytes} [Tue Jun 14 19:36:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:36:31.642290 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-fcba7bd5-2fce-45b2-be76-35806c49f84b admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:36:31.650471 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-fcba7bd5-2fce-45b2-be76-35806c49f84b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013333 Jun 14 19:36:31.651007 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1285 bytes} [Tue Jun 14 19:36:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:36:31.662984 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-01a7d774-9522-4fa8-a6dd-ddbeb328dd17 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:36:31.671126 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-01a7d774-9522-4fa8-a6dd-ddbeb328dd17 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011716 Jun 14 19:36:31.671667 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1285 bytes} [Tue Jun 14 19:36:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:36:31.684497 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-9febd031-2c0a-4948-83dd-436282e922a6 admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:36:31.693883 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-9febd031-2c0a-4948-83dd-436282e922a6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013305 Jun 14 19:36:31.694348 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1282 bytes} [Tue Jun 14 19:36:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:39:50.895368 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-01a7d774-9522-4fa8-a6dd-ddbeb328dd17 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:39:50.896375 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-01a7d774-9522-4fa8-a6dd-ddbeb328dd17 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 14 19:39:50.896766 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 14 19:39:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:39:51.055351 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG dbcounter [-] [109701] Writing DB stats nova_api:SELECT=6 {{(pid=109701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:39:51.190975 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-81699dee-f35b-4420-8088-2b40081934c5 admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:39:51.192130 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:39:51.192130 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: warnings.warn(msg) Jun 14 19:39:51.193321 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-81699dee-f35b-4420-8088-2b40081934c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:39:51.193816 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-81699dee-f35b-4420-8088-2b40081934c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:39:51.194597 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-81699dee-f35b-4420-8088-2b40081934c5 admin admin] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:39:51.195023 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-81699dee-f35b-4420-8088-2b40081934c5 admin admin] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:39:51.228681 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-81699dee-f35b-4420-8088-2b40081934c5 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.174711 Jun 14 19:39:51.229224 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jun 14 19:39:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:39:52.117879 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-01a7d774-9522-4fa8-a6dd-ddbeb328dd17 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:39:52.118893 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-01a7d774-9522-4fa8-a6dd-ddbeb328dd17 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 14 19:39:52.119309 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 14 19:39:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:39:52.318008 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-f3fb7222-74fa-4fcc-a884-757c9abf507f admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:39:52.319210 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:39:52.319210 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: warnings.warn(msg) Jun 14 19:39:52.320552 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-f3fb7222-74fa-4fcc-a884-757c9abf507f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:39:52.320995 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-f3fb7222-74fa-4fcc-a884-757c9abf507f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:39:52.321912 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-f3fb7222-74fa-4fcc-a884-757c9abf507f admin admin] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:39:52.322423 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-f3fb7222-74fa-4fcc-a884-757c9abf507f admin admin] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:39:52.342574 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-f3fb7222-74fa-4fcc-a884-757c9abf507f admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079749 Jun 14 19:39:52.343122 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jun 14 19:39:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:40:03.614600 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-01a7d774-9522-4fa8-a6dd-ddbeb328dd17 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:40:03.615602 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-01a7d774-9522-4fa8-a6dd-ddbeb328dd17 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 14 19:40:03.615993 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 14 19:40:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:40:03.759650 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG dbcounter [-] [109701] Writing DB stats nova_cell0:SELECT=4 {{(pid=109701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:40:03.760372 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG dbcounter [-] [109701] Writing DB stats nova_cell1:SELECT=4 {{(pid=109701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:40:03.760976 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG dbcounter [-] [109701] Writing DB stats nova_api:SELECT=8 {{(pid=109701) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:40:03.809628 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-1b885c65-ef01-494b-b457-cc497f8d468d admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:40:03.810834 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:40:03.810834 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: warnings.warn(msg) Jun 14 19:40:03.812064 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-1b885c65-ef01-494b-b457-cc497f8d468d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:40:03.812544 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-1b885c65-ef01-494b-b457-cc497f8d468d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:40:03.813338 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-1b885c65-ef01-494b-b457-cc497f8d468d admin admin] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:40:03.813797 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-1b885c65-ef01-494b-b457-cc497f8d468d admin admin] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:40:03.838984 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-1b885c65-ef01-494b-b457-cc497f8d468d admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083660 Jun 14 19:40:03.839543 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jun 14 19:40:03 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:40:04.722883 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: DEBUG nova.api.openstack.wsgi [None req-01a7d774-9522-4fa8-a6dd-ddbeb328dd17 admin admin] Calling method '>' {{(pid=109700) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:40:04.723926 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: INFO nova.api.openstack.requestlog [None req-01a7d774-9522-4fa8-a6dd-ddbeb328dd17 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 14 19:40:04.724321 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: [pid: 109700|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 14 19:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:40:04.917602 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG nova.api.openstack.wsgi [None req-23974aec-f4bb-4d1b-977d-72904c80e936 admin admin] Calling method '>' {{(pid=109701) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:40:04.918762 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:40:04.918762 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: warnings.warn(msg) Jun 14 19:40:04.920031 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-23974aec-f4bb-4d1b-977d-72904c80e936 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:40:04.920474 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-23974aec-f4bb-4d1b-977d-72904c80e936 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:40:04.921267 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-23974aec-f4bb-4d1b-977d-72904c80e936 admin admin] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:40:04.921729 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: DEBUG oslo_concurrency.lockutils [None req-23974aec-f4bb-4d1b-977d-72904c80e936 admin admin] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109701) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:40:04.943632 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: INFO nova.api.openstack.requestlog [None req-23974aec-f4bb-4d1b-977d-72904c80e936 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079569 Jun 14 19:40:04.944119 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: [pid: 109701|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jun 14 19:40:04 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:41:02.218352 dv-cinder-845806-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 14 19:41:02.218908 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: Tue Jun 14 19:41:02 2022 - graceful shutdown triggered... Jun 14 19:41:02.219364 dv-cinder-845806-1-iscsi devstack@n-api.service[109700]: Gracefully killing worker 1 (pid: 109700)... Jun 14 19:41:02.219747 dv-cinder-845806-1-iscsi devstack@n-api.service[109701]: Gracefully killing worker 2 (pid: 109701)... Jun 14 19:41:03.220045 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: worker 1 buried after 1 seconds Jun 14 19:41:03.220464 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: worker 2 buried after 1 seconds Jun 14 19:41:03.220464 dv-cinder-845806-1-iscsi devstack@n-api.service[109699]: goodbye to uWSGI. Jun 14 19:41:03.221689 dv-cinder-845806-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 14 19:41:03.222240 dv-cinder-845806-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 14 19:41:03.224997 dv-cinder-845806-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 14 19:41:03.235395 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 14 19:41:03.237418 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 14 19:41:03 2022] *** Jun 14 19:41:03.237550 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 14 19:41:03.237550 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 14 19:41:03.237550 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: nodename: dv-cinder-845806-1-iscsi Jun 14 19:41:03.237550 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: machine: x86_64 Jun 14 19:41:03.237550 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: clock source: unix Jun 14 19:41:03.237550 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: pcre jit disabled Jun 14 19:41:03.237550 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: detected number of CPU cores: 4 Jun 14 19:41:03.237550 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: current working directory: / Jun 14 19:41:03.237550 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: detected binary path: /usr/bin/uwsgi-core Jun 14 19:41:03.237550 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: your processes number limit is 47680 Jun 14 19:41:03.237550 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: your memory page size is 4096 bytes Jun 14 19:41:03.237550 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: detected max file descriptor number: 2048 Jun 14 19:41:03.237550 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: lock engine: pthread robust mutexes Jun 14 19:41:03.238477 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: thunder lock: enabled Jun 14 19:41:03.238477 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 14 19:41:03.238477 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 14 19:41:03.285363 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: Python main interpreter initialized at 0x565479a749c0 Jun 14 19:41:03.285363 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: python threads support enabled Jun 14 19:41:03.285363 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: your server socket listen backlog is limited to 100 connections Jun 14 19:41:03.285363 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: your mercy for graceful operations on workers is 90 seconds Jun 14 19:41:03.285769 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: mapped 403077 bytes (393 KB) for 2 cores Jun 14 19:41:03.285846 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: *** Operational MODE: preforking *** Jun 14 19:41:03.286127 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: *** uWSGI is running in multiple interpreter mode *** Jun 14 19:41:03.286127 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: spawned uWSGI master process (pid: 124049) Jun 14 19:41:03.302456 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: spawned uWSGI worker 1 (pid: 124068, cores: 1) Jun 14 19:41:03.302456 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: spawned uWSGI worker 2 (pid: 124069, cores: 1) Jun 14 19:41:03.302456 dv-cinder-845806-1-iscsi devstack@n-api.service[124049]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 14 19:41:03.286329 dv-cinder-845806-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 14 19:41:03.952105 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 14 19:41:03.961471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 14 19:41:05.205216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 19:41:05.205216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: from cryptography.utils import int_from_bytes Jun 14 19:41:05.205833 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 19:41:05.205833 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: from cryptography.utils import int_from_bytes Jun 14 19:41:05.252840 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 19:41:05.252840 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: from cryptography.utils import int_from_bytes Jun 14 19:41:05.253654 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 19:41:05.253654 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: from cryptography.utils import int_from_bytes Jun 14 19:41:07.612443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 19:41:07.613029 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 19:41:07.613230 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 19:41:07.613634 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 19:41:07.613901 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 19:41:07.614301 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.614634 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.614962 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.615288 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.615626 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.615949 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.616274 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.616604 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.616935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.617201 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.617549 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.617890 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845806-1-iscsi {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.618218 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.618536 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.618857 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.619182 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.619500 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.619830 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.620146 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.620707 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.621490 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.621836 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.622304 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.622533 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.622969 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.623231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.623697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.624578 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.625153 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.625495 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.625885 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845806-1-iscsi {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.626273 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.626572 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.626923 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.627333 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.627755 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.628107 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.628428 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.628858 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.629269 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.629700 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.630072 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.630511 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.630849 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.631282 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.631928 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.632303 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.632637 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.632958 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.633326 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.633649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.634000 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.634333 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.634668 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.635075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.635342 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.635637 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.635970 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.636306 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.636625 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.636956 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.637264 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.637646 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.638057 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.638310 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.638629 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.639559 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.639956 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.640344 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.640785 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.641133 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.641537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.641981 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.642244 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.642567 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.642924 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.643254 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.643575 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.643907 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.644239 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.644557 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.644875 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.645192 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.645547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.645899 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.646213 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.646472 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.646785 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.647100 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.647428 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.647745 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.648063 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.648378 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.648688 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.649003 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.649317 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.649663 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.649979 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.650295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.650626 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.650924 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.651239 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.651549 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.651876 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.652222 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.652518 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.652832 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.653146 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.653483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.653812 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.654129 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.655044 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.655544 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.655973 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.656294 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.656625 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.656942 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.657265 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.657622 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.658201 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.658517 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.658842 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.659159 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.659474 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.659787 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.660102 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.660415 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.660727 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.661038 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.661355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.661686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.662013 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.662340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.662656 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.662970 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.663318 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.663661 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.664035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.664376 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.664945 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.665475 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.665818 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.666162 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.666495 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.666820 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.667152 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.667490 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.667810 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.668973 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.668973 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.668973 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.669234 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.669326 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 19:41:07.669779 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.669868 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 19:41:07.669992 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.670690 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.670969 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 19:41:07.671060 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.671367 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 19:41:07.671522 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.671681 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 19:41:07.671855 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.672023 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.672126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.672220 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.672342 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.672479 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.672574 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.672701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.672880 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.673040 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.673235 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.673334 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.673602 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.673797 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.673938 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.674128 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.674275 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.674460 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.674597 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.674724 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.674919 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.675045 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.675240 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.675374 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845806-1-iscsi {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.675575 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.675700 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.675920 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.676021 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.676241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.676333 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.676570 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.676667 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.676891 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.676991 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.677215 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.677315 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.677546 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.677637 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.677872 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.678064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.678219 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.678369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.678525 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.678676 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.678852 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.678989 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.679176 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.679332 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.679498 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.679647 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.679825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.679959 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.680145 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.680283 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.680466 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.680594 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.680785 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.680921 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.681099 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.681232 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.681441 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.681663 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845806-1-iscsi {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.681846 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.682081 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.682172 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.682283 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.682382 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.682599 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.682691 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.683001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.683098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.683310 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.683410 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.683621 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.683712 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.683942 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.684035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.684261 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.684362 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.684573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.684669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.684890 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.684987 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.685206 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.685310 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.685566 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.685720 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.685895 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.685986 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.686199 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.686302 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.686511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.686602 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.686822 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.686919 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.687142 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.687233 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.687448 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.687538 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.687754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.687852 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.688009 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.688103 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.688320 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.688420 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.688644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.688782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.688966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.689075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.689294 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.689428 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.689576 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.689688 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.689828 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.689961 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.690149 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.690285 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.690471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.690607 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.690781 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.690953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.691091 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.691292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.691395 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.691606 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.691697 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.691938 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.692168 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.692307 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.692405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.692616 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.692723 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.692890 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.693027 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.693211 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.693336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.693553 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.693683 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.693878 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.693995 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.694223 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.694358 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.694499 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.694618 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.694848 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.694972 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.695138 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.695269 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.695448 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.695565 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.695757 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.695885 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.696069 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.696189 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.696394 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.696519 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.696710 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.696825 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.697027 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.697154 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.697335 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.697602 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.697714 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.701583 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.701687 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.701948 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.702086 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.702167 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.702248 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.702342 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.702425 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.702514 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.702514 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.702662 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.702742 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.702821 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.702894 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.702978 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.703071 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.703151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.703230 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.703310 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.703389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.703476 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.703556 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.703635 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.703707 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.703777 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.704685 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.704901 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.705060 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.705235 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.705312 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.705420 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.706199 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.706279 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.706351 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.706421 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.706500 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.706681 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.706768 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.706842 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.706912 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.706982 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.707052 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.707130 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.707212 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.707292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.707371 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.707442 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.707512 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.707512 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.707658 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.707731 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.707809 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.707891 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.707963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.708040 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.708111 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.708201 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.708364 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.708460 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.708533 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.708603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.708673 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.708751 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.708833 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.708915 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.708995 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.709075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.709148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.709217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.709296 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.709369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.711146 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.711337 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.711522 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.711715 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.711936 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.712130 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.712312 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.712502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.712684 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.712880 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.713082 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.713274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.713497 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.713664 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.713822 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.713981 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.714133 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.714279 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.714431 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.714577 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.714577 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.714866 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.715014 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.715176 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.715329 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.715475 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.715620 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.715778 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.715932 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.716077 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.716222 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.716366 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.716526 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.716671 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.717342 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.717535 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.717701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:41:07.717855 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.718016 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.718165 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.718317 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.718470 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.718470 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.718753 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.718912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.719065 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.719213 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.719358 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.719631 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.719833 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.720010 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.720160 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.720324 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.720782 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.720782 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.721325 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.721496 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.721654 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.721808 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.721960 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.721960 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.722260 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.722408 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.722552 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.722697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.722842 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.722986 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.723139 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.723290 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.723449 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.723601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.723754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.723906 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.724060 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.724216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.724370 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.724516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.724661 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.724814 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.724967 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.725120 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.725265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.725465 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.725618 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.725776 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.725922 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.726080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.726241 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.726386 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.726532 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.726686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.726839 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.726993 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.727145 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.727290 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.727443 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.727602 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.727748 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.727899 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.728062 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.728214 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.728369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.728513 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.728666 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.728811 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.728974 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.729239 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.729442 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.729611 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.729767 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.729911 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.730064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.730219 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.730384 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.730548 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.731003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.731399 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.731560 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.731708 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.731869 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.731869 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.732156 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.732310 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.732465 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.733260 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.733453 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.733656 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.733827 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.733982 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.734141 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.734306 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.734306 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.734595 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.734755 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.734917 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.735078 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.735250 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.735411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.735586 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.735739 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.735908 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.736069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.736221 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.736373 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.736531 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.736698 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.736850 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.737002 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.737153 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.737304 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.737490 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.737662 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.737814 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.738020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.738181 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.738181 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.738468 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.738628 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.738781 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.738941 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.739095 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.739252 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.739404 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.739404 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.739793 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.739954 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.740115 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.740268 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.740434 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.740586 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.740738 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.741186 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.741667 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.741837 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.742000 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.742154 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.742327 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.742488 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.742639 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.742798 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.742973 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.743134 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.743288 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.743440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.743603 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.743756 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.743924 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.744077 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.744228 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.744400 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.744561 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.744733 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.744884 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.745045 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.745206 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.745366 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.745553 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.745720 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.745871 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.746023 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.746180 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.746351 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.746511 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.746677 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.746837 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.746997 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.747156 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.747309 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.747470 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.747629 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.747787 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.747946 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.748197 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.748367 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.748545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.748708 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.748867 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.749030 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.749190 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.749350 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.749573 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.749736 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.749896 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.750055 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.750214 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.750375 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.750537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.750713 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.750865 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.751294 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.751490 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.751900 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.752069 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.752223 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.752375 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.752527 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.752697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.752860 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.753013 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.753165 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.753335 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.753514 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.753708 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.753918 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.754081 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.754266 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.754436 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.754702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.754896 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.755099 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.755309 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.755509 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.755718 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.755911 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.755911 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.756286 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.756474 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.756671 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.756861 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.757049 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.757247 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.757445 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.757630 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.757795 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.757957 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.758119 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.758286 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.758446 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.758599 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.758823 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.758995 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.759149 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.759314 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.759475 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.759636 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.759788 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.759985 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.760161 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.760335 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.760489 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.760650 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.760804 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.760990 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.761186 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.761633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.762096 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.762262 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.762415 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.762567 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.762729 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.762883 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.763045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.763201 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.763353 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.763505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.763694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.764290 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.764449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.764603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.764755 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.764918 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.765071 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.765236 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.765438 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.765611 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.765764 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.765934 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.766088 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.766239 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.766392 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.766614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.766784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.766952 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.767105 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.767266 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.767419 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.767592 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.767745 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.767951 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.768106 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.768266 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.768466 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.768629 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.768791 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.768952 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.769112 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.769264 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.769448 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.769608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.769786 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.769939 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.770109 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.770262 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.770413 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.770574 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.770735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.770896 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.771048 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.771208 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.771368 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.771797 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.772217 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.772399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.772553 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.772714 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.772873 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.773034 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.773034 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.773338 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.773568 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.773731 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.773884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.774046 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.774214 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.774374 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.774537 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.774690 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.774849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.775016 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.775169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.775329 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.775489 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.775641 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.775800 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.776036 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.776192 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.776343 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.776496 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.776496 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.776800 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.776962 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.777114 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.777273 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.777443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.777603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.777773 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.777928 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.778079 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.778238 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.778390 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.778568 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.778735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.778904 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.779057 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.779209 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.779878 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.780048 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.780211 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.780372 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.780533 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.780694 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.780847 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.781002 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.781173 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.781327 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.781947 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.782368 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.782531 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.782701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.783126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.783291 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.783445 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.783598 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.783759 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.783926 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.784088 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.784253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.784406 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.784566 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.784718 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.784953 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.785116 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.785278 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.785460 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.785620 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.785823 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.785987 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.785987 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.786288 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.786453 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.786605 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.786771 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.786931 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.787086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.787237 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.787237 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.787533 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.787699 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.787859 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.788011 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.788163 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.788327 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.788486 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.788648 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.788807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.788968 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.789128 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.789288 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.789571 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.789749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.789903 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.790062 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.790215 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.790375 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.790552 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.790706 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.790865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.791026 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.791189 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.791341 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.791494 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.791494 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.791820 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.792365 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.792648 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.792892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.793050 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.793216 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.793369 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.793563 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.793726 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.793880 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.794039 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.794192 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.794352 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.794519 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.794693 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.796040 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.796220 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.796396 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.796551 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.796724 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.796888 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.797050 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.797204 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.797357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.797535 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.797702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.797857 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.798058 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.798224 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.798387 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.798387 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.798699 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.798861 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.799021 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.799181 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.799335 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.799499 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.799652 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.799805 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.799966 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.800126 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.800278 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.800690 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.800866 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.801021 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.801174 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.801334 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.801538 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.801709 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.801872 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.802408 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.802582 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.802847 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.803041 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.803284 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.803455 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.803617 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.803777 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.803939 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.804108 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.804262 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.804414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.804573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.804729 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.804882 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.805042 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.805196 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.805349 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.805536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.805691 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.805854 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.806016 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.806179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.806331 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.806491 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.806652 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.806814 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.806975 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.807135 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.807135 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.807441 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.807608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.807772 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.807935 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.808088 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.808241 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.808393 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.808545 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.808711 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.808874 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.809026 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.809179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.809332 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.809971 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.810154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.810310 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.810310 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.810627 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.810787 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.810951 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.811125 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.812000 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.812194 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.812194 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.812892 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.813159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.813344 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.813777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.813938 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.814101 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.814254 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.814419 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.814582 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.814744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.814904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.815059 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.815219 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.815968 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.816132 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.816306 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.816461 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.817249 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.817435 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.817609 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.817780 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.817942 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.818095 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.818259 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.818412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.818572 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.818727 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.818899 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.819052 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.819287 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.819451 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.819604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.819764 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.819994 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.820173 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.820339 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.820494 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.820655 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.820816 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.820983 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.821158 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.821312 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.821551 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.821726 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.821883 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.822042 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.822211 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.822373 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.822948 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.823111 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.823415 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.823692 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.823981 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.824156 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.824320 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.824482 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.824636 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.824790 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.824958 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.825122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.825276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.825459 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.825635 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.825790 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.825943 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.826097 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.826308 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.826466 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.826466 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.829074 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.829464 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.829657 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.829824 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.829983 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.830158 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.830335 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.830512 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.830810 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.830973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.831150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.831308 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.831461 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.831614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.831777 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.831931 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.832100 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.832254 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.832417 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.832572 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.832572 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.833268 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.833622 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.833796 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.833978 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.834242 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.834401 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.834556 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.834723 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.834877 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.835039 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.835200 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.835360 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.835529 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.835691 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.835864 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.836019 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.836181 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.836335 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.836521 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.836716 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.836872 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.837033 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.837188 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.837348 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.837542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.837708 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.837880 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.838043 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.838195 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.838358 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.838518 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.838672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.838845 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.839000 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.839161 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.839327 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.839489 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.839649 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.839649 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.839966 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.840124 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.840286 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.840440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.840601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.840756 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.840998 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.840998 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.841307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.841539 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.841706 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.842379 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.842550 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.842713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.842884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.843306 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.843478 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.843747 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.843910 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.844077 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.844258 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.844504 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.844672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.844672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.844672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.844672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.844672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.844672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.844672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.844672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.845884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.845884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.845884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.845884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.845884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.845884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.845884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.845884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.847121 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.847121 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.847121 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.847562 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.847736 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.847736 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.847915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.848005 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.848079 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.848174 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.848260 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.848345 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.848430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.848521 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.848614 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.848713 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.848794 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.848874 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.848954 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.849033 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.849033 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.849177 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.849258 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.849331 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.849499 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.849585 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.849665 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.849747 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.849821 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.849892 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.849971 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.850052 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.850138 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.850219 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.850292 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.850292 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.850427 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.850427 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.850579 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.850653 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.850731 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.850804 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.850874 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.850952 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.851056 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.851130 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.851200 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.851279 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.851353 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.851423 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.851503 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.851583 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.851663 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.851743 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.851823 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.851823 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.851974 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.852054 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.852134 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.852208 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.852280 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.852360 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.852360 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.852497 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.852570 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.852640 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.852710 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.852790 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.852871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.852945 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.853023 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.853023 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.853580 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.853676 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.853784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.853860 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.853931 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.854002 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.854083 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.854157 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.854228 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.854307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.854380 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.854761 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.854863 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.854947 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.855021 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.855099 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.855181 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.855258 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.855338 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.855412 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.855481 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.855481 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.855626 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.855699 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.855784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.855858 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.855929 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.855998 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.856067 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.856151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.856231 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.856316 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.856403 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.856476 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.856546 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.856630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.856712 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.856784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.856854 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.856924 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.856994 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.857079 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.857152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.857223 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.857301 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.857389 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.857580 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.858228 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.858306 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.858377 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.858448 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.858519 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.858600 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.858600 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.858600 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.858600 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.858600 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.858895 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.858975 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.859052 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.859131 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.859211 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.859291 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.859370 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.859451 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.859541 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.859622 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.859622 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.859760 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.859840 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.859929 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.860002 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.860080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.860153 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.860223 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.860303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.860376 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.860454 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.860527 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.860597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.860668 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.860752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.860825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.860904 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.860904 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.861033 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.861104 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.861184 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.861257 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.861327 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.861436 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.861512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.861596 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.861679 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.861753 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.861832 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.861905 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.861975 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.862058 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.862133 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.862211 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.862284 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.862363 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.862448 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.862530 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.862603 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.862681 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.862761 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.862835 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.862906 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.863057 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.863133 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.863210 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.863735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.863735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.863890 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.863965 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.864044 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.864124 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.864197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.864268 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.864352 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.864425 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.864505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.864585 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.864657 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.864913 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.865022 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.865106 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.865180 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.865180 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.865316 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.865417 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.865507 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.865582 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.865662 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.865735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.865806 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.865890 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.865964 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.866035 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.866106 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.866183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.866256 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.866336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.866416 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.866496 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.866576 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.866576 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.866716 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.866716 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.866872 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.866953 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.867033 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.867112 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.867198 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.867272 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.867351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.867424 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.867502 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.867581 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.867667 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.867741 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.867820 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.867892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.867963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.868043 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.868116 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.868186 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.868186 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.868321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.868395 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.868475 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.868556 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.868628 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.868764 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.868930 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.869102 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.869278 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.869466 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.869667 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.869789 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.870008 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.870106 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.870345 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.870430 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.870665 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.870929 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.871023 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.871254 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.871339 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.871589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.871680 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.871918 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.872000 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.872313 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.872414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.872547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.872631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.872861 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.872955 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.873239 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.873325 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.873806 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.873893 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.873965 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.874088 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.874183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.874407 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.874492 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.874723 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.874814 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.875086 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.875183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.875354 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.875440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.875670 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.875752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.875985 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.876070 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.876301 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.876392 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.876612 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.877276 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.877548 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.877639 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.877726 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.877801 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.877871 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.877952 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.878026 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.878178 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.878365 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.878499 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.878630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.878811 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.878946 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.879140 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.879290 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.879450 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.879633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.879762 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.879963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.880085 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.880295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.880402 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.880618 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.880717 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.880951 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.881043 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.881269 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.881353 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.881621 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.881708 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.881941 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.882024 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.882257 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.882340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.882565 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.882650 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.882898 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.882981 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.883209 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.883300 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.883515 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.883619 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.884045 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.884119 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.884200 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.884288 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.884416 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.884502 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.884722 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.884816 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.885030 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.885316 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.885586 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.885672 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.885806 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.885897 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.885971 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.886052 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.886280 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.886364 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.886588 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.886672 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.886901 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.886997 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.887208 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.887301 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.887520 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.887633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.887873 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.888073 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.888199 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.888506 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.888612 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.888752 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.888849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.889076 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.889166 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.889788 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.889880 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.889953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.890046 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.890122 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.890201 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.890427 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.890531 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.890706 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.890855 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.891029 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.891179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.891368 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.891703 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.891805 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.892049 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.892132 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.892371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.892453 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.892706 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.892802 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.893042 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.893135 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.893353 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.893506 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.893697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.894140 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.894242 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.894317 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.894389 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 19:41:07.894461 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.894630 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.894944 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.895356 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.895580 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.895895 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.896209 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.896524 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.896837 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.897149 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.897565 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.897801 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.898113 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.898429 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.898747 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.899091 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.899414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.899735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.900056 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.900382 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.900695 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.901009 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.901321 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.901675 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.901996 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.902326 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.902643 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.902951 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.903380 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.903694 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.904276 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.904900 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.905353 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.906084 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.906084 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.906321 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.907052 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.907052 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.907265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.907607 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.908208 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.908534 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.908969 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.909147 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.912746 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.912746 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.912746 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.912746 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.912746 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.912746 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.912746 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.912746 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.914536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.914536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.914536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.914536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.914536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.914536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.914536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.914536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.915701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.915701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.915701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.915701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.915701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.915701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.916874 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.916874 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.916874 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.917331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.917331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.917657 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.917902 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.918288 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.918535 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.918861 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.919185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.919508 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.919829 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.920766 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.921089 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.921541 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.921870 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.922187 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.922954 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.922954 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.923293 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.923465 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.923758 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.924089 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.924412 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.924739 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.925060 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.925393 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.925730 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.926048 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.926363 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.926681 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.926998 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.927313 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.927633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.927954 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.928284 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.928612 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.928926 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.929256 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.929611 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.929965 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.930282 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.930630 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.930965 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.931282 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.931597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.931903 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:41:07.932149 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 19:41:07.959280 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO dbcounter [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] Registered counter for database nova_api Jun 14 19:41:07.979421 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_db.sqlalchemy.engines [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:41:07.987134 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writer thread running {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:41:07.995272 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO dbcounter [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] Registered counter for database nova_api Jun 14 19:41:08.014721 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_db.sqlalchemy.engines [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:41:08.022374 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writer thread running {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:41:08.045773 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.context [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f1fc354-1074-4113-b102-f8e074c62626(cell1) {{(pid=124068) load_cells /opt/stack/nova/nova/context.py:464}} Jun 14 19:41:08.049972 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:41:08.051564 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:41:08.052364 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:41:08.054371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:41:08.056406 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO dbcounter [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] Registered counter for database nova_cell0 Jun 14 19:41:08.060315 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO dbcounter [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] Registered counter for database nova_cell1 Jun 14 19:41:08.068054 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_db.sqlalchemy.engines [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:41:08.070296 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_db.sqlalchemy.engines [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:41:08.076141 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writer thread running {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:41:08.078415 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writer thread running {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:41:08.080840 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.context [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f1fc354-1074-4113-b102-f8e074c62626(cell1) {{(pid=124069) load_cells /opt/stack/nova/nova/context.py:464}} Jun 14 19:41:08.085000 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:41:08.086622 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:41:08.087416 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:41:08.089418 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:41:08.091427 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO dbcounter [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] Registered counter for database nova_cell0 Jun 14 19:41:08.096311 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO dbcounter [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] Registered counter for database nova_cell1 Jun 14 19:41:08.103792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_db.sqlalchemy.engines [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:41:08.105523 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_db.sqlalchemy.engines [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:41:08.112562 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writer thread running {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:41:08.112905 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writer thread running {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:41:08.226515 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO dbcounter [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] Registered counter for database nova_cell0 Jun 14 19:41:08.233151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_db.sqlalchemy.engines [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:41:08.237728 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writer thread running {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:41:08.259678 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO dbcounter [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] Registered counter for database nova_cell0 Jun 14 19:41:08.268976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_db.sqlalchemy.engines [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:41:08.273629 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writer thread running {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:41:08.562925 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: WARNING keystonemiddleware.auth_token [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 19:41:08.570350 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: WARNING keystonemiddleware.auth_token [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 19:41:08.600236 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: WARNING keystonemiddleware.auth_token [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 19:41:08.608209 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: WARNING keystonemiddleware.auth_token [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 19:41:08.919535 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: WARNING keystonemiddleware.auth_token [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 19:41:08.925732 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: WARNING keystonemiddleware.auth_token [None req-6de7b6de-e3c8-40e4-aa5d-c8d187ca488e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 19:41:08.931085 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x565479a749c0 pid: 124068 (default app) Jun 14 19:41:08.959534 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: WARNING keystonemiddleware.auth_token [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 19:41:08.965493 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: WARNING keystonemiddleware.auth_token [None req-88c45632-3f73-4e67-99bc-c4b36667f6a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 19:41:08.971543 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x565479a749c0 pid: 124069 (default app) Jun 14 19:41:48.271636 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=3 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:48.272772 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=3 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:48.273896 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=3 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:48.274791 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=3 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:49.182661 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-2320fabb-8fd1-4105-bb98-12c8e9b8415f tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Action: 'create', calling method: .version_select at 0x7f14515b2790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-499352490"}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:41:49.457510 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=3 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:49.459184 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=3 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:49.460142 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=3 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:49.462110 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=3 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:50.423566 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4d647599-938b-42f0-8b49-f54d0ad3dd6f tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Action: 'create', calling method: .version_select at 0x7f14515b4790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-813709996", "metadata": {"Type": "work"}}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4d647599-938b-42f0-8b49-f54d0ad3dd6f tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Request method failure captured: Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 121 Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOR90s2zPQ_hs9K7zcPOesmKth3_GYYvsJS1jF1xZwg4Bh89Xn-CharTwPLgmIT3XwFcgdYNHnT-ZYhbEcesImXEUcYSsIpU29GSqxsbIafF_W_xJeqZOP6h0nMhAGZ2ydEp2aNtwgv8YnPsWQ-gYU7SbP3VRy4yKXuRzNCZmlok844 Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: bbda946832c44bbca1cc41990e32e861 Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:41:50.457992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:41:50.460875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bbda946832c44bbca1cc41990e32e861"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bbda946832c44bbca1cc41990e32e861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bbda946832c44bbca1cc41990e32e861"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bbda946832c44bbca1cc41990e32e861"}]}] Jun 14 19:41:50.460875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:50.460875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: bbda946832c44bbca1cc41990e32e861 Jun 14 19:41:50.460875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:50.460875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-VolumesNegativeTest-428790852-project Jun 14 19:41:50.460875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:41:50.460875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:41:50.460875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 359d538415604ef78c8e9ed0753231a5 Jun 14 19:41:50.460875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-VolumesNegativeTest-428790852-project Jun 14 19:41:50.460875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Jun 14 19:41:50.460875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-813709996", "metadata": {"Type": "work"}}} Jun 14 19:41:50.460875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: Jun 14 19:41:50.460875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-813709996', 'metadata': {'Type': 'work'}}}} Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise error Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi '#$%' Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:41:50.462414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 14 19:41:50.464020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 14 19:41:50.465905 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 14 19:41:50.465905 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:50.465905 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4d647599-938b-42f0-8b49-f54d0ad3dd6f tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:41:50.468399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4d647599-938b-42f0-8b49-f54d0ad3dd6f tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.016314 Jun 14 19:41:50.469225 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1155 bytes} [Tue Jun 14 19:41:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1020 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 14 19:41:50.639838 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-93c27488-0302-497d-bf54-278d1e55850e tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] Action: 'create', calling method: .version_select at 0x7f145157aa60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1604834365", "metadata": {"Type": "work"}}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:41:50.959895 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-2320fabb-8fd1-4105-bb98-12c8e9b8415f tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.705456 Jun 14 19:41:50.960836 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 1/2] 10.222.0.44 () {60 vars in 1154 bytes} [Tue Jun 14 19:41:48 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2708 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 14 19:41:50.968447 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-20a4a717-c929-4212-8e4c-34a7a6e825f0 tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Action: 'create', calling method: .version_select at 0x7f1451479550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1977394677", "metadata": {"Type": "work"}}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-20a4a717-c929-4212-8e4c-34a7a6e825f0 tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Request method failure captured: Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 120 Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOR90s2zPQ_hs9K7zcPOesmKth3_GYYvsJS1jF1xZwg4Bh89Xn-CharTwPLgmIT3XwFcgdYNHnT-ZYhbEcesImXEUcYSsIpU29GSqxsbIafF_W_xJeqZOP6h0nMhAGZ2ydEp2aNtwgv8YnPsWQ-gYU7SbP3VRy4yKXuRzNCZmlok844 Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: bbda946832c44bbca1cc41990e32e861 Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:41:50.976987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:41:50.978501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bbda946832c44bbca1cc41990e32e861"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bbda946832c44bbca1cc41990e32e861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bbda946832c44bbca1cc41990e32e861"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bbda946832c44bbca1cc41990e32e861"}]}] Jun 14 19:41:50.978501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:50.978501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: bbda946832c44bbca1cc41990e32e861 Jun 14 19:41:50.978501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:50.978501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-VolumesNegativeTest-428790852-project Jun 14 19:41:50.978501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:41:50.978501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:41:50.978501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 359d538415604ef78c8e9ed0753231a5 Jun 14 19:41:50.978501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-VolumesNegativeTest-428790852-project Jun 14 19:41:50.978501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Jun 14 19:41:50.978501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1977394677", "metadata": {"Type": "work"}}} Jun 14 19:41:50.978501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: Jun 14 19:41:50.978501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1977394677', 'metadata': {'Type': 'work'}}}} Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise error Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi '0' Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:41:50.979454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 14 19:41:50.980737 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 14 19:41:50.982413 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 14 19:41:50.982413 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:50.982413 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-20a4a717-c929-4212-8e4c-34a7a6e825f0 tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:41:50.982413 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-20a4a717-c929-4212-8e4c-34a7a6e825f0 tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016338 Jun 14 19:41:50.982413 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 2/3] 10.222.0.44 () {60 vars in 1155 bytes} [Tue Jun 14 19:41:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 14 19:41:50.998614 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c1a45e48-de2d-463a-a5fd-4dbba4574087 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f1451479550>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:51.099505 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c1a45e48-de2d-463a-a5fd-4dbba4574087 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b" status: 200 len: 344 microversion: 2.1 time: 0.116922 Jun 14 19:41:51.100220 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 3/4] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 14 19:41:50 2022] GET /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b => generated 344 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:41:51.104698 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0965b243-c342-4772-a495-afb52e175e83 tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Action: 'create', calling method: .version_select at 0x7f1451479430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-974088769", "metadata": {"Type": "work"}}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0965b243-c342-4772-a495-afb52e175e83 tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Request method failure captured: Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 118 Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOR90s2zPQ_hs9K7zcPOesmKth3_GYYvsJS1jF1xZwg4Bh89Xn-CharTwPLgmIT3XwFcgdYNHnT-ZYhbEcesImXEUcYSsIpU29GSqxsbIafF_W_xJeqZOP6h0nMhAGZ2ydEp2aNtwgv8YnPsWQ-gYU7SbP3VRy4yKXuRzNCZmlok844 Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: bbda946832c44bbca1cc41990e32e861 Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:41:51.108045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:41:51.109412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bbda946832c44bbca1cc41990e32e861"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bbda946832c44bbca1cc41990e32e861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bbda946832c44bbca1cc41990e32e861"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bbda946832c44bbca1cc41990e32e861"}]}] Jun 14 19:41:51.109412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:51.109412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: bbda946832c44bbca1cc41990e32e861 Jun 14 19:41:51.109412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:51.109412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-VolumesNegativeTest-428790852-project Jun 14 19:41:51.109412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:41:51.109412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:41:51.109412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 359d538415604ef78c8e9ed0753231a5 Jun 14 19:41:51.109412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-VolumesNegativeTest-428790852-project Jun 14 19:41:51.109412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Jun 14 19:41:51.109412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-974088769", "metadata": {"Type": "work"}}} Jun 14 19:41:51.109412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: Jun 14 19:41:51.109412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-974088769', 'metadata': {'Type': 'work'}}}} Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise error Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi '' Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:41:51.110194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 14 19:41:51.111613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 14 19:41:51.112849 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 14 19:41:51.112849 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.114541 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0965b243-c342-4772-a495-afb52e175e83 tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:41:51.117670 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-0965b243-c342-4772-a495-afb52e175e83 tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014388 Jun 14 19:41:51.118681 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 4/5] 10.222.0.44 () {60 vars in 1155 bytes} [Tue Jun 14 19:41:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 14 19:41:51.134201 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-28df60e0-bfb7-4216-ba90-6bbe286e8acb tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Calling method '.version_select at 0x7f145142cf70>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:51.458516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-28df60e0-bfb7-4216-ba90-6bbe286e8acb tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] HTTP exception thrown: Volume tempest-invalid-1956809404 could not be found. Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-28df60e0-bfb7-4216-ba90-6bbe286e8acb tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Request method failure captured: Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1956809404 HTTP/1.1 Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOR90s2zPQ_hs9K7zcPOesmKth3_GYYvsJS1jF1xZwg4Bh89Xn-CharTwPLgmIT3XwFcgdYNHnT-ZYhbEcesImXEUcYSsIpU29GSqxsbIafF_W_xJeqZOP6h0nMhAGZ2ydEp2aNtwgv8YnPsWQ-gYU7SbP3VRy4yKXuRzNCZmlok844 Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: bbda946832c44bbca1cc41990e32e861 Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:41:51.462545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:41:51.464148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bbda946832c44bbca1cc41990e32e861"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bbda946832c44bbca1cc41990e32e861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bbda946832c44bbca1cc41990e32e861"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bbda946832c44bbca1cc41990e32e861"}]}] Jun 14 19:41:51.464148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:51.464148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: bbda946832c44bbca1cc41990e32e861 Jun 14 19:41:51.464148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:51.464148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-VolumesNegativeTest-428790852-project Jun 14 19:41:51.464148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:41:51.464148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:41:51.464148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 359d538415604ef78c8e9ed0753231a5 Jun 14 19:41:51.464148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-VolumesNegativeTest-428790852-project Jun 14 19:41:51.464148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: Jun 14 19:41:51.464148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Volume tempest-invalid-1956809404 could not be found. Jun 14 19:41:51.464148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': 'tempest-invalid-1956809404'} Jun 14 19:41:51.464148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1956809404 could not be found. (HTTP 404) (Request-ID: req-7701bb1c-cbf1-43c8-9a7a-b1639f94ac14) Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:51.465735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 19:41:51.467147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1956809404 could not be found. Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:41:51.468483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1956809404 could not be found. Jun 14 19:41:51.469921 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.469921 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:51.469921 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.469921 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:51.469921 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:51.469921 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:51.469921 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:41:51.469921 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:41:51.469921 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1956809404 could not be found. Jun 14 19:41:51.469921 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.471824 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-28df60e0-bfb7-4216-ba90-6bbe286e8acb tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Returning 404 to user: Volume tempest-invalid-1956809404 could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:41:51.473135 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-28df60e0-bfb7-4216-ba90-6bbe286e8acb tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1956809404" status: 404 len: 99 microversion: 2.1 time: 0.345846 Jun 14 19:41:51.477158 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 5/6] 10.222.0.44 () {58 vars in 1217 bytes} [Tue Jun 14 19:41:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1956809404 => generated 99 bytes in 347 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 14 19:41:51.488515 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-01c5fc6f-e7ce-4887-b44d-4e7947dc0229 tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010089 Jun 14 19:41:51.490767 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 6/7] 10.222.0.44 () {58 vars in 1139 bytes} [Tue Jun 14 19:41:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 14 19:41:51.499222 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d0ab73d2-207f-4a27-a28b-49b5f914dd39 tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004916 Jun 14 19:41:51.499770 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 7/8] 10.222.0.44 () {58 vars in 1136 bytes} [Tue Jun 14 19:41:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 14 19:41:51.526485 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-02f3ca91-eac0-4baf-ad09-e2f5677c8a65 tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Calling method '.version_select at 0x7f14514175e0>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:51.589073 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-02f3ca91-eac0-4baf-ad09-e2f5677c8a65 tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] HTTP exception thrown: Volume 1bbadc00-069e-4884-983d-4c915ff36869 could not be found. Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-02f3ca91-eac0-4baf-ad09-e2f5677c8a65 tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Request method failure captured: Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: DELETE /compute/v2.1/os-volumes/1bbadc00-069e-4884-983d-4c915ff36869 HTTP/1.1 Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOR90s2zPQ_hs9K7zcPOesmKth3_GYYvsJS1jF1xZwg4Bh89Xn-CharTwPLgmIT3XwFcgdYNHnT-ZYhbEcesImXEUcYSsIpU29GSqxsbIafF_W_xJeqZOP6h0nMhAGZ2ydEp2aNtwgv8YnPsWQ-gYU7SbP3VRy4yKXuRzNCZmlok844 Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: bbda946832c44bbca1cc41990e32e861 Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:41:51.592512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:41:51.593768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bbda946832c44bbca1cc41990e32e861"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bbda946832c44bbca1cc41990e32e861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bbda946832c44bbca1cc41990e32e861"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bbda946832c44bbca1cc41990e32e861"}]}] Jun 14 19:41:51.593768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:51.593768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: bbda946832c44bbca1cc41990e32e861 Jun 14 19:41:51.593768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:51.593768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-VolumesNegativeTest-428790852-project Jun 14 19:41:51.593768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:41:51.593768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:41:51.593768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 359d538415604ef78c8e9ed0753231a5 Jun 14 19:41:51.593768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-VolumesNegativeTest-428790852-project Jun 14 19:41:51.593768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: Jun 14 19:41:51.593768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Volume 1bbadc00-069e-4884-983d-4c915ff36869 could not be found. Jun 14 19:41:51.593768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': '1bbadc00-069e-4884-983d-4c915ff36869'} Jun 14 19:41:51.593768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1bbadc00-069e-4884-983d-4c915ff36869 could not be found. (HTTP 404) (Request-ID: req-a4da2779-a746-4fbc-ab68-f6ba417c17ca) Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:51.594488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 19:41:51.596977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1bbadc00-069e-4884-983d-4c915ff36869 could not be found. Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 14 19:41:51.598061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:41:51.600719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1bbadc00-069e-4884-983d-4c915ff36869 could not be found. Jun 14 19:41:51.600719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.600719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:51.600719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.600719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:51.600719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:51.600719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:51.600719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:41:51.600719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:41:51.600719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1bbadc00-069e-4884-983d-4c915ff36869 could not be found. Jun 14 19:41:51.600719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.600719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-02f3ca91-eac0-4baf-ad09-e2f5677c8a65 tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Returning 404 to user: Volume 1bbadc00-069e-4884-983d-4c915ff36869 could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:41:51.600719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-02f3ca91-eac0-4baf-ad09-e2f5677c8a65 tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/1bbadc00-069e-4884-983d-4c915ff36869" status: 404 len: 109 microversion: 2.1 time: 0.083561 Jun 14 19:41:51.600719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 8/9] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 14 19:41:51 2022] DELETE /compute/v2.1/os-volumes/1bbadc00-069e-4884-983d-4c915ff36869 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:41:51.612023 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e578a7ab-93aa-4b1b-a797-63502ea787bb tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Calling method '.version_select at 0x7f1451417a60>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:51.659221 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-e578a7ab-93aa-4b1b-a797-63502ea787bb tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] HTTP exception thrown: Volume c3dad8f1-e7bb-40db-9502-6a270922e43d could not be found. Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e578a7ab-93aa-4b1b-a797-63502ea787bb tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Request method failure captured: Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/os-volumes/c3dad8f1-e7bb-40db-9502-6a270922e43d HTTP/1.1 Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOR90s2zPQ_hs9K7zcPOesmKth3_GYYvsJS1jF1xZwg4Bh89Xn-CharTwPLgmIT3XwFcgdYNHnT-ZYhbEcesImXEUcYSsIpU29GSqxsbIafF_W_xJeqZOP6h0nMhAGZ2ydEp2aNtwgv8YnPsWQ-gYU7SbP3VRy4yKXuRzNCZmlok844 Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: bbda946832c44bbca1cc41990e32e861 Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:41:51.661179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:41:51.662697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bbda946832c44bbca1cc41990e32e861"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bbda946832c44bbca1cc41990e32e861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bbda946832c44bbca1cc41990e32e861"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bbda946832c44bbca1cc41990e32e861"}]}] Jun 14 19:41:51.662697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:51.662697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: bbda946832c44bbca1cc41990e32e861 Jun 14 19:41:51.662697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-VolumesNegativeTest-428790852 Jun 14 19:41:51.662697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-VolumesNegativeTest-428790852-project Jun 14 19:41:51.662697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:41:51.662697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:41:51.662697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 359d538415604ef78c8e9ed0753231a5 Jun 14 19:41:51.662697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-VolumesNegativeTest-428790852-project Jun 14 19:41:51.662697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: Jun 14 19:41:51.662697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Volume c3dad8f1-e7bb-40db-9502-6a270922e43d could not be found. Jun 14 19:41:51.662697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': 'c3dad8f1-e7bb-40db-9502-6a270922e43d'} Jun 14 19:41:51.662697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c3dad8f1-e7bb-40db-9502-6a270922e43d could not be found. (HTTP 404) (Request-ID: req-35f34045-a385-4915-b46b-a70889a6888b) Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:51.663581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 19:41:51.664713 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c3dad8f1-e7bb-40db-9502-6a270922e43d could not be found. Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 14 19:41:51.665825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:41:51.666870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c3dad8f1-e7bb-40db-9502-6a270922e43d could not be found. Jun 14 19:41:51.666870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.666870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:51.666870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.666870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:51.666870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:51.666870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:51.666870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:41:51.666870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:41:51.666870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c3dad8f1-e7bb-40db-9502-6a270922e43d could not be found. Jun 14 19:41:51.666870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:51.666870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e578a7ab-93aa-4b1b-a797-63502ea787bb tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] Returning 404 to user: Volume c3dad8f1-e7bb-40db-9502-6a270922e43d could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:41:51.666870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e578a7ab-93aa-4b1b-a797-63502ea787bb tempest-VolumesNegativeTest-428790852 tempest-VolumesNegativeTest-428790852-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c3dad8f1-e7bb-40db-9502-6a270922e43d" status: 404 len: 109 microversion: 2.1 time: 0.062920 Jun 14 19:41:51.666870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 9/10] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 14 19:41:51 2022] GET /compute/v2.1/os-volumes/c3dad8f1-e7bb-40db-9502-6a270922e43d => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:41:52.113203 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-fb6a4b09-a0b7-4a94-b64d-4d86ae92414a tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f1451417430>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:52.174681 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-93c27488-0302-497d-bf54-278d1e55850e tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.703670 Jun 14 19:41:52.175974 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 2/11] 10.222.0.44 () {60 vars in 1155 bytes} [Tue Jun 14 19:41:50 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1706 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 14 19:41:52.190353 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-5f33fdf9-4ebd-476d-a4f6-0df908c9afee tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] Calling method '.version_select at 0x7f1451430af0>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:52.256026 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-fb6a4b09-a0b7-4a94-b64d-4d86ae92414a tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b" status: 200 len: 345 microversion: 2.1 time: 0.147295 Jun 14 19:41:52.256579 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 10/12] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 14 19:41:52 2022] GET /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b => generated 345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:41:52.268929 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-657a2029-5fc4-4108-b81c-c189d37ff4ea tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Action: 'create', calling method: .version_select at 0x7f1451417e50>, body: {"snapshot": {"volume_id": "233d3249-87e9-47c4-ae24-6ea0289d773b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2141055801"}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:41:52.281913 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-5f33fdf9-4ebd-476d-a4f6-0df908c9afee tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e" status: 200 len: 353 microversion: 2.1 time: 0.096065 Jun 14 19:41:52.283451 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 3/13] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 14 19:41:52 2022] GET /compute/v2.1/os-volumes/dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:41:52.624219 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-657a2029-5fc4-4108-b81c-c189d37ff4ea tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.359636 Jun 14 19:41:52.625256 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 11/14] 10.222.0.44 () {60 vars in 1161 bytes} [Tue Jun 14 19:41:52 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:41:52.636666 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-bfb5b1f3-52ce-43fe-b819-4573de7d43c2 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f14514441f0>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:52.789615 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-bfb5b1f3-52ce-43fe-b819-4573de7d43c2 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51" status: 200 len: 287 microversion: 2.1 time: 0.157551 Jun 14 19:41:52.790852 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 4/15] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 14 19:41:52 2022] GET /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51 => generated 287 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:41:52.801614 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-12db7301-23e6-459a-9587-d05c66604fef tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f145142cb80>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:52.893920 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-12db7301-23e6-459a-9587-d05c66604fef tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.092798 Jun 14 19:41:52.902229 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 12/16] 10.222.0.44 () {58 vars in 1139 bytes} [Tue Jun 14 19:41:52 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:41:52.905967 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9c6fdb93-c7b8-4869-9078-cb5a19f042e7 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f1451444940>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:52.972004 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9c6fdb93-c7b8-4869-9078-cb5a19f042e7 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51" status: 200 len: 287 microversion: 2.1 time: 0.070841 Jun 14 19:41:52.973011 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 5/17] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 14 19:41:52 2022] GET /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:41:53.295925 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-6d196c0a-4f82-43d1-8685-c6451f4667c6 tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] Calling method '.version_select at 0x7f1451423ca0>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:53.365740 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-6d196c0a-4f82-43d1-8685-c6451f4667c6 tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e" status: 200 len: 354 microversion: 2.1 time: 0.074049 Jun 14 19:41:53.375785 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 13/18] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 14 19:41:53 2022] GET /compute/v2.1/os-volumes/dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:41:53.380627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-0103384b-1ab6-40ff-a3d9-3252cde30b54 tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] Calling method '.version_select at 0x7f1451430c10>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:53.483322 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-0103384b-1ab6-40ff-a3d9-3252cde30b54 tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e" status: 200 len: 354 microversion: 2.1 time: 0.106008 Jun 14 19:41:53.484705 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 6/19] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 14 19:41:53 2022] GET /compute/v2.1/os-volumes/dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:41:53.500481 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9441a4ed-bf4d-45ad-b266-a79c6ad8b1a7 tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] Calling method '.version_select at 0x7f1451423160>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:53.619360 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9441a4ed-bf4d-45ad-b266-a79c6ad8b1a7 tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e" status: 202 len: 0 microversion: 2.1 time: 0.122704 Jun 14 19:41:53.620386 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 14/20] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 14 19:41:53 2022] DELETE /compute/v2.1/os-volumes/dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:41:53.630176 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1ec52531-3d7e-4625-99f1-ba4bc190cad4 tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] Calling method '.version_select at 0x7f1451444c10>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:53.716206 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-1ec52531-3d7e-4625-99f1-ba4bc190cad4 tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e" status: 200 len: 353 microversion: 2.1 time: 0.090126 Jun 14 19:41:53.722341 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 7/21] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 14 19:41:53 2022] GET /compute/v2.1/os-volumes/dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:41:53.984493 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e211add5-7875-41a9-963b-37b81050f168 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f145142cb80>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:54.036735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e211add5-7875-41a9-963b-37b81050f168 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51" status: 200 len: 287 microversion: 2.1 time: 0.056407 Jun 14 19:41:54.037310 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 15/22] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 14 19:41:53 2022] GET /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:41:54.471548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-236623538", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "networks": [{"uuid": "13bdbcbf-06c0-43fa-accd-8842399e1921"}]}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:41:54.643985 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.network.neutron [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] validate_networks() for [('13bdbcbf-06c0-43fa-accd-8842399e1921', None, None, None, None, None)] {{(pid=124069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:41:54.733215 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-127876b3-b369-4a8d-acd4-7fc8f878e88a tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] Calling method '.version_select at 0x7f14514171f0>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:54.834822 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-127876b3-b369-4a8d-acd4-7fc8f878e88a tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e" status: 200 len: 353 microversion: 2.1 time: 0.108560 Jun 14 19:41:54.837632 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 16/23] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 14 19:41:54 2022] GET /compute/v2.1/os-volumes/dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:41:55.050273 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a971cb8b-9cdc-46e9-a0ff-9f1dfdb4c458 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f1451423ee0>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:55.156804 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a971cb8b-9cdc-46e9-a0ff-9f1dfdb4c458 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51" status: 200 len: 287 microversion: 2.1 time: 0.110299 Jun 14 19:41:55.158467 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 17/24] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 14 19:41:55 2022] GET /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51 => generated 287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:41:55.851654 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1d2aecda-904b-4ec4-bffb-0e2f8b026d06 tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] Calling method '.version_select at 0x7f1451423430>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:55.997413 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-1d2aecda-904b-4ec4-bffb-0e2f8b026d06 tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] HTTP exception thrown: Volume dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e could not be found. Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1d2aecda-904b-4ec4-bffb-0e2f8b026d06 tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] Request method failure captured: Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/os-volumes/dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e HTTP/1.1 Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOR9KKw3mSzepS8VTlMwtzv2i0cBc6XhkcUucH0szo4eb3--lVNc6bdpFsURi-GRTazLU9tz_W6gggmFhRliwtmV0zURUJ1Ohtt2Uvu9mWm8TT-VoIurl3Dq-PBqMwAA9hdl-rmaYDd-qUR1yW8nE-cO0dhFHb7rCWMtWOMtaStcNeA Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: 605b211405114782b9b1273be4dbed6a Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-VolumesGetTestJSON-963171152 Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:41:56.000479 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:41:56.002150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/605b211405114782b9b1273be4dbed6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_605b211405114782b9b1273be4dbed6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/605b211405114782b9b1273be4dbed6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/605b211405114782b9b1273be4dbed6a"}]}] Jun 14 19:41:56.002150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-VolumesGetTestJSON-963171152 Jun 14 19:41:56.002150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: 605b211405114782b9b1273be4dbed6a Jun 14 19:41:56.002150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-VolumesGetTestJSON-963171152 Jun 14 19:41:56.002150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-VolumesGetTestJSON-963171152-project Jun 14 19:41:56.002150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:41:56.002150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:41:56.002150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 16b898f7b0f34154910942558578a19c Jun 14 19:41:56.002150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-VolumesGetTestJSON-963171152-project Jun 14 19:41:56.002150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: Jun 14 19:41:56.002150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Volume dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e could not be found. Jun 14 19:41:56.002150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': 'dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e'} Jun 14 19:41:56.002150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e could not be found. (HTTP 404) (Request-ID: req-60a4042e-c6a7-43f4-af54-7ad414227a9e) Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:56.003080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 19:41:56.004292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e could not be found. Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 14 19:41:56.005492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:41:56.006633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e could not be found. Jun 14 19:41:56.006633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:56.006633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:56.006633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:56.006633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:56.006633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:56.006633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:56.006633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:41:56.006633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:41:56.006633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e could not be found. Jun 14 19:41:56.006633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:56.010695 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1d2aecda-904b-4ec4-bffb-0e2f8b026d06 tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] Returning 404 to user: Volume dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:41:56.015504 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1d2aecda-904b-4ec4-bffb-0e2f8b026d06 tempest-VolumesGetTestJSON-963171152 tempest-VolumesGetTestJSON-963171152-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e" status: 404 len: 109 microversion: 2.1 time: 0.168716 Jun 14 19:41:56.017449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 18/25] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 14 19:41:55 2022] GET /compute/v2.1/os-volumes/dba0eedc-c71d-4b08-aff6-ff5cd7f26a3e => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 19:41:56.170908 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-563b0ff8-9824-4d8c-a755-1869de73b607 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f1451423160>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:56.239776 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-563b0ff8-9824-4d8c-a755-1869de73b607 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51" status: 200 len: 288 microversion: 2.1 time: 0.074745 Jun 14 19:41:56.240720 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 19/26] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 14 19:41:56 2022] GET /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51 => generated 288 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:41:56.255561 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-6a6dd05d-9855-498b-b91b-b08bc96ddf03 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f1451423ca0>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:56.401478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-6a6dd05d-9855-498b-b91b-b08bc96ddf03 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51" status: 202 len: 0 microversion: 2.1 time: 0.153476 Jun 14 19:41:56.404553 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 20/27] 10.222.0.44 () {58 vars in 1253 bytes} [Tue Jun 14 19:41:56 2022] DELETE /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:41:56.415309 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b65177f6-6c78-43dc-a8e6-846edf1a105c tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f145142ca60>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:56.506517 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b65177f6-6c78-43dc-a8e6-846edf1a105c tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51" status: 200 len: 287 microversion: 2.1 time: 0.095596 Jun 14 19:41:56.510669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 21/28] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 14 19:41:56 2022] GET /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51 => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:41:57.427408 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Flavor limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:41:57.428001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Image limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:41:57.428488 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Flavor pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:41:57.428918 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Image pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:41:57.429323 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:41:57.456818 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:41:57.457261 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:41:57.458088 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:41:57.458772 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:41:57.519038 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c2c28503-3565-4a38-b00a-bb25ee196809 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f1451419040>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:57.555841 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Getting quotas for project 58bb3d02c5c043d39785a31a7ee33b35. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:41:57.567884 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-c2c28503-3565-4a38-b00a-bb25ee196809 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] HTTP exception thrown: Snapshot 8fd5392e-1895-44f1-974a-35cba7285b51 could not be found. Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c2c28503-3565-4a38-b00a-bb25ee196809 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Request method failure captured: Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51 HTTP/1.1 Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOR8JmEYnCWS5dhajbDlkWve0Exc3kAdrNhL45D1vKfVJEDa4aVeLa7GDiplN46RiC3H4VwYq21Ugmvo4umRGfjcjAiT-0WFaAPpSTS5JZtnlL2oNzhnUQpjprA8AXsH7SsupxQIKkwTli0s8Eg8hhvTq_JzkkEbBPFHEpRikGuvS4E Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: b6c6e94029f24878baa7012e883ce5af Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-798881002 Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:41:57.575414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:41:57.576977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6c6e94029f24878baa7012e883ce5af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b6c6e94029f24878baa7012e883ce5af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b6c6e94029f24878baa7012e883ce5af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6c6e94029f24878baa7012e883ce5af"}]}] Jun 14 19:41:57.576977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-VolumesSnapshotsTestJSON-798881002 Jun 14 19:41:57.576977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: b6c6e94029f24878baa7012e883ce5af Jun 14 19:41:57.576977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-798881002 Jun 14 19:41:57.576977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-VolumesSnapshotsTestJSON-798881002-project Jun 14 19:41:57.576977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:41:57.576977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:41:57.576977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: d7b608ebc4714a379b30857a06f701c6 Jun 14 19:41:57.576977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-VolumesSnapshotsTestJSON-798881002-project Jun 14 19:41:57.576977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: Jun 14 19:41:57.576977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Snapshot 8fd5392e-1895-44f1-974a-35cba7285b51 could not be found. Jun 14 19:41:57.576977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': '8fd5392e-1895-44f1-974a-35cba7285b51'} Jun 14 19:41:57.576977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8fd5392e-1895-44f1-974a-35cba7285b51 could not be found. (HTTP 404) (Request-ID: req-a093d346-cff2-48a7-b8c8-a2ad39191c89) Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:57.578028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 19:41:57.578912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8fd5392e-1895-44f1-974a-35cba7285b51 could not be found. Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 14 19:41:57.580443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:41:57.581577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8fd5392e-1895-44f1-974a-35cba7285b51 could not be found. Jun 14 19:41:57.581577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:57.581577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:57.581577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:57.581577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:57.581577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:57.581577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:57.581577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:41:57.581577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:41:57.581577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8fd5392e-1895-44f1-974a-35cba7285b51 could not be found. Jun 14 19:41:57.581577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:57.581577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c2c28503-3565-4a38-b00a-bb25ee196809 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Returning 404 to user: Snapshot 8fd5392e-1895-44f1-974a-35cba7285b51 could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:41:57.581577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c2c28503-3565-4a38-b00a-bb25ee196809 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51" status: 404 len: 111 microversion: 2.1 time: 0.061919 Jun 14 19:41:57.581577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 22/29] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 14 19:41:57 2022] GET /compute/v2.1/os-snapshots/8fd5392e-1895-44f1-974a-35cba7285b51 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 19:41:57.591007 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Getting quotas for user 54575b28e7ec4f04a9884a35d5feec2e and project 58bb3d02c5c043d39785a31a7ee33b35. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:41:57.599035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0a05cde6-bbc9-444e-bfc2-e5c2bde22275 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f1451e61c10>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:57.644175 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Going to run 1 instances... {{(pid=124069) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:41:57.651606 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:41:57.786714 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-0a05cde6-bbc9-444e-bfc2-e5c2bde22275 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b" status: 202 len: 0 microversion: 2.1 time: 0.203090 Jun 14 19:41:57.787800 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 23/30] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 14 19:41:57 2022] DELETE /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:41:57.799560 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1e9f0e37-e103-4a1e-9801-ebdcdd41b38b tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f14514230d0>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:57.877498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-0c06a0cb-4ba2-4c7f-99e6-2aed3599fa1f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.663152 Jun 14 19:41:57.878763 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 8/31] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:41:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:41:57.896473 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-51df74d0-a5cb-4e0d-9bc6-759a20e8d8a4 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:57.907682 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-51df74d0-a5cb-4e0d-9bc6-759a20e8d8a4 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:41:57.953943 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1e9f0e37-e103-4a1e-9801-ebdcdd41b38b tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b" status: 200 len: 344 microversion: 2.1 time: 0.160868 Jun 14 19:41:57.959939 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 24/32] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 14 19:41:57 2022] GET /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b => generated 344 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:41:58.414985 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-51df74d0-a5cb-4e0d-9bc6-759a20e8d8a4 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:41:58.440833 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-51df74d0-a5cb-4e0d-9bc6-759a20e8d8a4 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1214 microversion: 2.1 time: 0.554607 Jun 14 19:41:58.446000 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 9/33] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:41:57 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1214 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:41:58.968269 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f02fa8b3-ef52-4d98-877e-c3cac1c3c415 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f14514195e0>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:59.032578 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-f02fa8b3-ef52-4d98-877e-c3cac1c3c415 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] HTTP exception thrown: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f02fa8b3-ef52-4d98-877e-c3cac1c3c415 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Request method failure captured: Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b HTTP/1.1 Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOR8JmEYnCWS5dhajbDlkWve0Exc3kAdrNhL45D1vKfVJEDa4aVeLa7GDiplN46RiC3H4VwYq21Ugmvo4umRGfjcjAiT-0WFaAPpSTS5JZtnlL2oNzhnUQpjprA8AXsH7SsupxQIKkwTli0s8Eg8hhvTq_JzkkEbBPFHEpRikGuvS4E Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: b6c6e94029f24878baa7012e883ce5af Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-798881002 Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:41:59.034839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:41:59.036137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6c6e94029f24878baa7012e883ce5af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b6c6e94029f24878baa7012e883ce5af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b6c6e94029f24878baa7012e883ce5af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6c6e94029f24878baa7012e883ce5af"}]}] Jun 14 19:41:59.036137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-VolumesSnapshotsTestJSON-798881002 Jun 14 19:41:59.036137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: b6c6e94029f24878baa7012e883ce5af Jun 14 19:41:59.036137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-798881002 Jun 14 19:41:59.036137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-VolumesSnapshotsTestJSON-798881002-project Jun 14 19:41:59.036137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:41:59.036137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:41:59.036137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: d7b608ebc4714a379b30857a06f701c6 Jun 14 19:41:59.036137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-VolumesSnapshotsTestJSON-798881002-project Jun 14 19:41:59.036137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: Jun 14 19:41:59.036137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. Jun 14 19:41:59.036137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': '233d3249-87e9-47c4-ae24-6ea0289d773b'} Jun 14 19:41:59.036137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. (HTTP 404) (Request-ID: req-71681557-65d3-4aa0-8a72-ab10d1fd9ded) Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:59.036935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 19:41:59.038078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 14 19:41:59.039131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:41:59.040276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. Jun 14 19:41:59.040276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.040276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:59.040276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.040276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:59.040276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:59.040276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:59.040276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:41:59.040276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:41:59.040276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. Jun 14 19:41:59.040276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.041589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f02fa8b3-ef52-4d98-877e-c3cac1c3c415 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Returning 404 to user: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:41:59.042615 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f02fa8b3-ef52-4d98-877e-c3cac1c3c415 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b" status: 404 len: 109 microversion: 2.1 time: 0.079062 Jun 14 19:41:59.044210 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 25/34] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 14 19:41:58 2022] GET /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:41:59.061679 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4f4fdec9-2657-4dbf-be08-61571a409a22 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f14572fddc0>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-4f4fdec9-2657-4dbf-be08-61571a409a22 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] HTTP exception thrown: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4f4fdec9-2657-4dbf-be08-61571a409a22 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Request method failure captured: Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: DELETE /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b HTTP/1.1 Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOR8JmEYnCWS5dhajbDlkWve0Exc3kAdrNhL45D1vKfVJEDa4aVeLa7GDiplN46RiC3H4VwYq21Ugmvo4umRGfjcjAiT-0WFaAPpSTS5JZtnlL2oNzhnUQpjprA8AXsH7SsupxQIKkwTli0s8Eg8hhvTq_JzkkEbBPFHEpRikGuvS4E Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: b6c6e94029f24878baa7012e883ce5af Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-798881002 Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:41:59.133438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:41:59.134511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6c6e94029f24878baa7012e883ce5af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b6c6e94029f24878baa7012e883ce5af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b6c6e94029f24878baa7012e883ce5af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6c6e94029f24878baa7012e883ce5af"}]}] Jun 14 19:41:59.134511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-VolumesSnapshotsTestJSON-798881002 Jun 14 19:41:59.134511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: b6c6e94029f24878baa7012e883ce5af Jun 14 19:41:59.134511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-798881002 Jun 14 19:41:59.134511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-VolumesSnapshotsTestJSON-798881002-project Jun 14 19:41:59.134511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:41:59.134511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:41:59.134511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: d7b608ebc4714a379b30857a06f701c6 Jun 14 19:41:59.134511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-VolumesSnapshotsTestJSON-798881002-project Jun 14 19:41:59.134511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: Jun 14 19:41:59.134511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. Jun 14 19:41:59.134511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '233d3249-87e9-47c4-ae24-6ea0289d773b'} Jun 14 19:41:59.134511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. (HTTP 404) (Request-ID: req-812da428-1e3b-4de8-b92d-c6c920bdaf55) Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:59.135169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 19:41:59.136203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 14 19:41:59.138198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:41:59.139063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. Jun 14 19:41:59.139063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.139063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:59.139063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.139063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:59.139063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:59.139063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:59.139063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:41:59.139063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:41:59.139063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. Jun 14 19:41:59.139063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.139063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4f4fdec9-2657-4dbf-be08-61571a409a22 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Returning 404 to user: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:41:59.139063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4f4fdec9-2657-4dbf-be08-61571a409a22 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b" status: 404 len: 109 microversion: 2.1 time: 0.076681 Jun 14 19:41:59.139063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 10/35] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 14 19:41:59 2022] DELETE /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:41:59.147884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-66d96b26-260e-4035-b2a6-163dbb3f6070 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Calling method '.version_select at 0x7f14515b4700>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:59.230506 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-66d96b26-260e-4035-b2a6-163dbb3f6070 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] HTTP exception thrown: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-66d96b26-260e-4035-b2a6-163dbb3f6070 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Request method failure captured: Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b HTTP/1.1 Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOR8JmEYnCWS5dhajbDlkWve0Exc3kAdrNhL45D1vKfVJEDa4aVeLa7GDiplN46RiC3H4VwYq21Ugmvo4umRGfjcjAiT-0WFaAPpSTS5JZtnlL2oNzhnUQpjprA8AXsH7SsupxQIKkwTli0s8Eg8hhvTq_JzkkEbBPFHEpRikGuvS4E Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: b6c6e94029f24878baa7012e883ce5af Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-798881002 Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:41:59.232984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:41:59.234296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6c6e94029f24878baa7012e883ce5af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b6c6e94029f24878baa7012e883ce5af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b6c6e94029f24878baa7012e883ce5af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b6c6e94029f24878baa7012e883ce5af"}]}] Jun 14 19:41:59.234296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-VolumesSnapshotsTestJSON-798881002 Jun 14 19:41:59.234296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: b6c6e94029f24878baa7012e883ce5af Jun 14 19:41:59.234296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-798881002 Jun 14 19:41:59.234296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-VolumesSnapshotsTestJSON-798881002-project Jun 14 19:41:59.234296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:41:59.234296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:41:59.234296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: d7b608ebc4714a379b30857a06f701c6 Jun 14 19:41:59.234296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-VolumesSnapshotsTestJSON-798881002-project Jun 14 19:41:59.234296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: Jun 14 19:41:59.234296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. Jun 14 19:41:59.234296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '233d3249-87e9-47c4-ae24-6ea0289d773b'} Jun 14 19:41:59.234296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. (HTTP 404) (Request-ID: req-583489c8-461a-4f77-a04e-2a37575fae3e) Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:59.235080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 19:41:59.236098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 14 19:41:59.237173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:41:59.238318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. Jun 14 19:41:59.238318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.238318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:41:59.238318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.238318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:41:59.238318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:41:59.238318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:41:59.238318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:41:59.238318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:41:59.238318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. Jun 14 19:41:59.238318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:41:59.240223 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-66d96b26-260e-4035-b2a6-163dbb3f6070 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] Returning 404 to user: Volume 233d3249-87e9-47c4-ae24-6ea0289d773b could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:41:59.240689 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-66d96b26-260e-4035-b2a6-163dbb3f6070 tempest-VolumesSnapshotsTestJSON-798881002 tempest-VolumesSnapshotsTestJSON-798881002-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b" status: 404 len: 109 microversion: 2.1 time: 0.097183 Jun 14 19:41:59.241943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 11/36] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 14 19:41:59 2022] GET /compute/v2.1/os-volumes/233d3249-87e9-47c4-ae24-6ea0289d773b => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:41:59.425120 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-ad338c1f-3186-414a-b13d-57e6c638263f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Action: 'create', calling method: .version_select at 0x7f14514238b0>, body: {"keypair": {"name": "tempest-keypair-1547246200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI78RaXN/PqZ8xdteHGjH5P27QxfO75H0GhW7qQyZKHkepu+Wm7S/zaT1dbxurti1NnxUMATJtZWfz5spScAj2DWqTh6fG5ek6TBqGaxuy3YLhRZOqPjuTwZKjcgsRpYHg=="}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:41:59.468399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-75c2149b-337b-4733-8528-f8edaed07394 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:41:59.470097 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-75c2149b-337b-4733-8528-f8edaed07394 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:41:59.533874 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-ad338c1f-3186-414a-b13d-57e6c638263f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Getting quotas for project 070bbe844e8945eca60ecc95244acd53. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:41:59.555467 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-ad338c1f-3186-414a-b13d-57e6c638263f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Getting quotas for user f60ed90fb1a54339ac563bc649e98989 and project 070bbe844e8945eca60ecc95244acd53. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:41:59.691610 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-ad338c1f-3186-414a-b13d-57e6c638263f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.557049 Jun 14 19:41:59.697180 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 26/37] 10.222.0.44 () {62 vars in 1199 bytes} [Tue Jun 14 19:41:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 563 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 14 19:41:59.922334 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-75c2149b-337b-4733-8528-f8edaed07394 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:41:59.936547 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-75c2149b-337b-4733-8528-f8edaed07394 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1214 microversion: 2.1 time: 0.473574 Jun 14 19:41:59.938045 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 12/38] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:41:59 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1214 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:00.966970 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-5dda3301-9bb8-4964-a862-1db89ed5c662 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:00.968762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-5dda3301-9bb8-4964-a862-1db89ed5c662 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:00.993521 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5dda3301-9bb8-4964-a862-1db89ed5c662 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:00.994784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5dda3301-9bb8-4964-a862-1db89ed5c662 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:00.996553 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5dda3301-9bb8-4964-a862-1db89ed5c662 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:00.997420 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5dda3301-9bb8-4964-a862-1db89ed5c662 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:02.083100 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-5dda3301-9bb8-4964-a862-1db89ed5c662 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:02.118874 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-5dda3301-9bb8-4964-a862-1db89ed5c662 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1266 microversion: 2.1 time: 1.166569 Jun 14 19:42:02.131466 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 27/39] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:00 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1266 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:03.138269 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d269dead-f1d2-434f-987a-113b4c227d20 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:03.141915 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d269dead-f1d2-434f-987a-113b4c227d20 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:03.162539 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d269dead-f1d2-434f-987a-113b4c227d20 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:03.163849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d269dead-f1d2-434f-987a-113b4c227d20 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:03.167255 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d269dead-f1d2-434f-987a-113b4c227d20 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:03.171186 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d269dead-f1d2-434f-987a-113b4c227d20 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:03.947477 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d269dead-f1d2-434f-987a-113b4c227d20 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:03.989687 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d269dead-f1d2-434f-987a-113b4c227d20 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1272 microversion: 2.1 time: 0.856103 Jun 14 19:42:03.996133 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 13/40] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:03 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1272 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:05.015461 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c6162a28-3ef6-4ec4-bd82-325ed6edd1a0 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:05.016003 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c6162a28-3ef6-4ec4-bd82-325ed6edd1a0 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:05.043320 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c6162a28-3ef6-4ec4-bd82-325ed6edd1a0 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:05.044085 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c6162a28-3ef6-4ec4-bd82-325ed6edd1a0 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:05.045091 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c6162a28-3ef6-4ec4-bd82-325ed6edd1a0 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:05.046717 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c6162a28-3ef6-4ec4-bd82-325ed6edd1a0 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:05.512754 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c6162a28-3ef6-4ec4-bd82-325ed6edd1a0 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:05.526416 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c6162a28-3ef6-4ec4-bd82-325ed6edd1a0 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1272 microversion: 2.1 time: 0.516330 Jun 14 19:42:05.529903 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 28/41] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:05 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1272 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:06.547274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-57f5affe-4096-40ed-ae26-f8ec83c50b3e tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:06.547875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-57f5affe-4096-40ed-ae26-f8ec83c50b3e tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:06.558959 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-57f5affe-4096-40ed-ae26-f8ec83c50b3e tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:06.570493 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-57f5affe-4096-40ed-ae26-f8ec83c50b3e tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:06.571380 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-57f5affe-4096-40ed-ae26-f8ec83c50b3e tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:06.572129 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-57f5affe-4096-40ed-ae26-f8ec83c50b3e tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:07.337085 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-57f5affe-4096-40ed-ae26-f8ec83c50b3e tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:07.353307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-57f5affe-4096-40ed-ae26-f8ec83c50b3e tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1272 microversion: 2.1 time: 0.807272 Jun 14 19:42:07.355975 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 14/42] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:06 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1272 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:08.379903 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9dbfe423-c812-4f88-bf62-e80fb635f2f1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:08.380353 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9dbfe423-c812-4f88-bf62-e80fb635f2f1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:08.393069 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9dbfe423-c812-4f88-bf62-e80fb635f2f1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:08.395992 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9dbfe423-c812-4f88-bf62-e80fb635f2f1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:08.399669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9dbfe423-c812-4f88-bf62-e80fb635f2f1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:08.400452 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9dbfe423-c812-4f88-bf62-e80fb635f2f1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:09.582494 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=4 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:10.080778 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9dbfe423-c812-4f88-bf62-e80fb635f2f1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:10.094507 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9dbfe423-c812-4f88-bf62-e80fb635f2f1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1314 microversion: 2.1 time: 1.720126 Jun 14 19:42:10.095460 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 29/43] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:08 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1314 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:11.114251 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-f65fc56f-fa78-4e77-a8d6-4c24c1209f41 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:11.115242 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-f65fc56f-fa78-4e77-a8d6-4c24c1209f41 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:11.134834 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:11.135554 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=10 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:11.157344 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f65fc56f-fa78-4e77-a8d6-4c24c1209f41 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:11.157943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f65fc56f-fa78-4e77-a8d6-4c24c1209f41 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:11.158861 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f65fc56f-fa78-4e77-a8d6-4c24c1209f41 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:11.159415 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f65fc56f-fa78-4e77-a8d6-4c24c1209f41 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:11.843157 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-462f4d65-cae9-404c-a69b-ddd7f8928b14 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Action: 'create', calling method: .version_select at 0x7f1450a36c10>, body: {"keypair": {"name": "tempest-keypair-137193103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEbFR3xm315h9ZMfhCSyaIihJMyNbgUZTRPalkphISiLCEMhyREcXzyZuDsmc48D7X39L3M2z9dklMSfUfyESAo20UPswuNG3msSsy3eBd+X9uHltJ0OkPmxjBAeM81HQ=="}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:11.859053 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-462f4d65-cae9-404c-a69b-ddd7f8928b14 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:42:11.863843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-462f4d65-cae9-404c-a69b-ddd7f8928b14 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for user 323c51f037db4ecca2f66cb6e9879246 and project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:42:11.900295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-462f4d65-cae9-404c-a69b-ddd7f8928b14 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.581300 Jun 14 19:42:11.902897 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 30/44] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 14 19:42:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:42:11.916007 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1882968770", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c8e1214-e4f6-4bbf-87ef-85a053e8689c"}], "security_groups": [{"name": "tempest-securitygroup--681974228"}], "key_name": "tempest-keypair-1547246200", "user_data": "}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:12.224735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-f65fc56f-fa78-4e77-a8d6-4c24c1209f41 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:12.240619 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-f65fc56f-fa78-4e77-a8d6-4c24c1209f41 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1314 microversion: 2.1 time: 1.126703 Jun 14 19:42:12.242107 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 15/45] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:11 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1314 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:12.730298 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-15449fe4-c4e6-4dcd-aeb3-6ae0c033ba0c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Action: 'create', calling method: .version_select at 0x7f14501fdee0>, body: {"keypair": {"name": "tempest-keypair-1088427712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNc67aFGQcGhlEph25aFg+lPXwka+q3sxdjdIb5Y3XkCZvd6vRRD9vHlkdBKoDtqqBnRX34LRhF58CRkzF7n2Y5k/pmO6rxBgzSMWMZH+aAXdCUL/Hg/0KxOmB6haej7Uw=="}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:12.760660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.network.neutron [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] validate_networks() for [('6c8e1214-e4f6-4bbf-87ef-85a053e8689c', None, None, None, None, None)] {{(pid=124068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:42:12.816428 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-15449fe4-c4e6-4dcd-aeb3-6ae0c033ba0c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Getting quotas for project f4aa8aab8447434b8619c3b7bb0b585a. Resources: {'key_pairs'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:42:12.833292 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-15449fe4-c4e6-4dcd-aeb3-6ae0c033ba0c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Getting quotas for user 18261f10678a4ce99626794c39bb5d7f and project f4aa8aab8447434b8619c3b7bb0b585a. Resources: {'key_pairs'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:42:12.992811 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-15449fe4-c4e6-4dcd-aeb3-6ae0c033ba0c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.620624 Jun 14 19:42:12.994091 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 16/46] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 14 19:42:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:42:13.152193 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-dad9959c-0611-4419-afc6-2f1cb07ef7fd req-3c7a2306-c5aa-49bb-b6ec-052aa58b77b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f063e7ec-ffab-48c6-b145-f51cd09dd5f4", "tag": "f795a935-08ef-44b7-807d-5af2326db545"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:13.179579 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-dad9959c-0611-4419-afc6-2f1cb07ef7fd req-3c7a2306-c5aa-49bb-b6ec-052aa58b77b9 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:13.179954 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-dad9959c-0611-4419-afc6-2f1cb07ef7fd req-3c7a2306-c5aa-49bb-b6ec-052aa58b77b9 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:13.207312 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-dad9959c-0611-4419-afc6-2f1cb07ef7fd req-3c7a2306-c5aa-49bb-b6ec-052aa58b77b9 service nova] Creating event network-changed:f795a935-08ef-44b7-807d-5af2326db545 for instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 on hv-cinder-84580 Jun 14 19:42:13.208111 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-dad9959c-0611-4419-afc6-2f1cb07ef7fd req-3c7a2306-c5aa-49bb-b6ec-052aa58b77b9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124069) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 14 19:42:13.209746 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-440b4d6d-f13b-4079-8a0c-da15240cfe27 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:13.210814 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-440b4d6d-f13b-4079-8a0c-da15240cfe27 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:13.211786 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-440b4d6d-f13b-4079-8a0c-da15240cfe27 None None] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:13.212382 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-440b4d6d-f13b-4079-8a0c-da15240cfe27 None None] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:13.230610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.compute.rpcapi [None req-440b4d6d-f13b-4079-8a0c-da15240cfe27 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 14 19:42:13.232434 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-440b4d6d-f13b-4079-8a0c-da15240cfe27 None None] Releasing lock "compute-rpcapi-router" {{(pid=124069) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 14 19:42:13.268938 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-440b4d6d-f13b-4079-8a0c-da15240cfe27 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265528 Jun 14 19:42:13.270113 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 17/47] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:42:13.282557 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-dd56c789-43ad-4ffc-9eb7-4819a0886386 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:13.289127 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-dd56c789-43ad-4ffc-9eb7-4819a0886386 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:13.298026 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dd56c789-43ad-4ffc-9eb7-4819a0886386 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:13.310127 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dd56c789-43ad-4ffc-9eb7-4819a0886386 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:13.310958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dd56c789-43ad-4ffc-9eb7-4819a0886386 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:13.311399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dd56c789-43ad-4ffc-9eb7-4819a0886386 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:14.160325 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-dd56c789-43ad-4ffc-9eb7-4819a0886386 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:14.169140 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-dd56c789-43ad-4ffc-9eb7-4819a0886386 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1314 microversion: 2.1 time: 0.897195 Jun 14 19:42:14.182649 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 18/48] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:13 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1314 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:15.208229 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-20f21e8b-e2b6-4948-ae90-96a47676ee50 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:15.208943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-20f21e8b-e2b6-4948-ae90-96a47676ee50 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:15.235846 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-20f21e8b-e2b6-4948-ae90-96a47676ee50 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:15.244729 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-20f21e8b-e2b6-4948-ae90-96a47676ee50 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:15.245819 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-20f21e8b-e2b6-4948-ae90-96a47676ee50 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:15.258223 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-20f21e8b-e2b6-4948-ae90-96a47676ee50 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:16.643831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Flavor limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:42:16.645347 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Image limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:42:16.645347 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Flavor pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:42:16.646003 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Image pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:42:16.646182 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:42:16.679753 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:16.680214 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:16.681625 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:16.682068 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:16.740614 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Getting quotas for project 070bbe844e8945eca60ecc95244acd53. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:42:16.756054 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Getting quotas for user f60ed90fb1a54339ac563bc649e98989 and project 070bbe844e8945eca60ecc95244acd53. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:42:16.783065 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Going to run 1 instances... {{(pid=124068) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:42:16.802442 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:42:16.949699 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e10137bf-11e8-41da-9a22-9846ed57aa35 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.045404 Jun 14 19:42:16.950723 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 31/49] 10.222.0.44 () {62 vars in 1187 bytes} [Tue Jun 14 19:42:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 5047 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 14 19:42:17.074740 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-20f21e8b-e2b6-4948-ae90-96a47676ee50 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:17.085813 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-20f21e8b-e2b6-4948-ae90-96a47676ee50 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1314 microversion: 2.1 time: 1.898456 Jun 14 19:42:17.086404 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 19/50] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:15 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1314 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:17.122232 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-00d1bda9-aa74-487f-8e27-a6b27736a7b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:17.123093 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-00d1bda9-aa74-487f-8e27-a6b27736a7b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:17.716874 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-00d1bda9-aa74-487f-8e27-a6b27736a7b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:17.731200 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1875300141", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:17.738527 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-00d1bda9-aa74-487f-8e27-a6b27736a7b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:17.743890 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-00d1bda9-aa74-487f-8e27-a6b27736a7b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:17.751441 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-00d1bda9-aa74-487f-8e27-a6b27736a7b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1282 microversion: 2.20 time: 0.648465 Jun 14 19:42:17.751946 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 20/51] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:17 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1282 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:17.864033 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.network.neutron [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] validate_networks() for [('306322ef-3e3f-44b4-b241-274a6f9c3423', None, None, None, None, None)] {{(pid=124068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:42:18.103063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2df99319-1463-4129-a966-2e09981d1f89 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:18.104226 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2df99319-1463-4129-a966-2e09981d1f89 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:18.120014 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2df99319-1463-4129-a966-2e09981d1f89 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:18.123374 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2df99319-1463-4129-a966-2e09981d1f89 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:18.124646 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2df99319-1463-4129-a966-2e09981d1f89 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:18.129478 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2df99319-1463-4129-a966-2e09981d1f89 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:19.324152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2df99319-1463-4129-a966-2e09981d1f89 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:19.339882 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2df99319-1463-4129-a966-2e09981d1f89 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1314 microversion: 2.1 time: 1.236342 Jun 14 19:42:19.340504 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 21/52] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:18 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1314 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:19.356418 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-35b367a5-73a9-445b-ba6a-14b2ea66f551 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:19.357257 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-35b367a5-73a9-445b-ba6a-14b2ea66f551 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:19.419973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-35b367a5-73a9-445b-ba6a-14b2ea66f551 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:19.423298 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-35b367a5-73a9-445b-ba6a-14b2ea66f551 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:19.424844 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-35b367a5-73a9-445b-ba6a-14b2ea66f551 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:19.427135 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-35b367a5-73a9-445b-ba6a-14b2ea66f551 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:19.819291 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-35b367a5-73a9-445b-ba6a-14b2ea66f551 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:19.822614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=47 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:19.857846 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-35b367a5-73a9-445b-ba6a-14b2ea66f551 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:19.860267 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-35b367a5-73a9-445b-ba6a-14b2ea66f551 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:19.864564 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-35b367a5-73a9-445b-ba6a-14b2ea66f551 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1334 microversion: 2.20 time: 0.521993 Jun 14 19:42:19.866871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 22/53] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:19 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1334 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:20.014180 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Flavor limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:42:20.015236 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Image limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:42:20.015899 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Flavor pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:42:20.016323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Image pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:42:20.016780 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:42:20.038012 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:20.038464 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:20.039268 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:20.039700 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:20.111550 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Getting quotas for project 05db8610cfa7449daeec7419d4f7ad6c. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:42:20.120638 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Getting quotas for user 9b28c3b97f9f44148dd02f41509887e8 and project 05db8610cfa7449daeec7419d4f7ad6c. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:42:20.134759 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-151677351", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0ba18e4-39c5-4788-b560-bb81504c2d7c"}], "security_groups": [{"name": "tempest-securitygroup--825867470"}], "key_name": "tempest-keypair-1088427712", "user_data": "}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:20.152743 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Going to run 1 instances... {{(pid=124068) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:42:20.160224 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:42:20.203050 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:20.272210 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-57cfc20b-8a0a-45d8-a596-ab4f9950f7ae tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.314360 Jun 14 19:42:20.279316 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 32/54] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:42:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 3322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:42:20.286828 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e818d255-55ef-4ae2-873b-7b82f2569952 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:20.294179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e818d255-55ef-4ae2-873b-7b82f2569952 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:20.466358 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-e818d255-55ef-4ae2-873b-7b82f2569952 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:20.491566 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e818d255-55ef-4ae2-873b-7b82f2569952 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1222 microversion: 2.1 time: 0.207567 Jun 14 19:42:20.507320 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 33/55] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:20 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1222 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:20.516438 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-cd6eb53b-53ac-465a-a2bf-b9678bf8e8b1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:20.517671 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-cd6eb53b-53ac-465a-a2bf-b9678bf8e8b1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:20.524842 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cd6eb53b-53ac-465a-a2bf-b9678bf8e8b1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:20.525500 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cd6eb53b-53ac-465a-a2bf-b9678bf8e8b1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:20.527029 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cd6eb53b-53ac-465a-a2bf-b9678bf8e8b1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:20.528284 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cd6eb53b-53ac-465a-a2bf-b9678bf8e8b1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:20.672203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.network.neutron [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] validate_networks() for [('d0ba18e4-39c5-4788-b560-bb81504c2d7c', None, None, None, None, None)] {{(pid=124069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:42:21.238361 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-cd6eb53b-53ac-465a-a2bf-b9678bf8e8b1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:21.251908 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-cd6eb53b-53ac-465a-a2bf-b9678bf8e8b1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1314 microversion: 2.1 time: 0.740997 Jun 14 19:42:21.252837 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 34/56] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:20 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1314 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:21.266579 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-303659529", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:21.366545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.network.neutron [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] validate_networks() for [('306322ef-3e3f-44b4-b241-274a6f9c3423', None, None, None, None, None)] {{(pid=124068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:42:22.553655 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Flavor limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:42:22.555966 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Image limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:42:22.559903 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Flavor pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:42:22.561062 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Image pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:42:22.563607 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:42:22.601036 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:22.602685 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:22.606355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:22.607947 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:22.653831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Getting quotas for project 05db8610cfa7449daeec7419d4f7ad6c. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:42:22.659273 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Getting quotas for user 9b28c3b97f9f44148dd02f41509887e8 and project 05db8610cfa7449daeec7419d4f7ad6c. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:42:22.675836 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Going to run 1 instances... {{(pid=124068) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:42:22.684090 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:42:22.777421 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f1c95a2d-91d7-4740-82e0-6c4784601029 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.522704 Jun 14 19:42:22.778103 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 35/57] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:42:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:42:22.805012 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f716c458-e8d1-4cbc-8668-83bb044eee2c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:22.805669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f716c458-e8d1-4cbc-8668-83bb044eee2c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:22.814695 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f716c458-e8d1-4cbc-8668-83bb044eee2c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:22.817064 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f716c458-e8d1-4cbc-8668-83bb044eee2c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:22.818892 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f716c458-e8d1-4cbc-8668-83bb044eee2c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:22.824721 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f716c458-e8d1-4cbc-8668-83bb044eee2c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:22.977098 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-f716c458-e8d1-4cbc-8668-83bb044eee2c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:22.990321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-f716c458-e8d1-4cbc-8668-83bb044eee2c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:22.996332 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-f716c458-e8d1-4cbc-8668-83bb044eee2c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:23.001832 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f716c458-e8d1-4cbc-8668-83bb044eee2c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1340 microversion: 2.20 time: 0.203941 Jun 14 19:42:23.016862 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 36/58] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:22 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1340 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:23.025268 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1dd39897-e92d-4e4e-9007-e554fc175459 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:23.029693 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1dd39897-e92d-4e4e-9007-e554fc175459 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:23.054432 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1dd39897-e92d-4e4e-9007-e554fc175459 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:23.062136 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1dd39897-e92d-4e4e-9007-e554fc175459 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:23.065506 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1dd39897-e92d-4e4e-9007-e554fc175459 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:23.066450 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1dd39897-e92d-4e4e-9007-e554fc175459 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:23.230805 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:23.320191 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Flavor limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:42:23.320839 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Image limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:42:23.321635 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Flavor pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:42:23.322166 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Image pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:42:23.322661 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:42:23.345193 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:23.347053 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:23.350123 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:23.352034 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:23.405891 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Getting quotas for project f4aa8aab8447434b8619c3b7bb0b585a. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:42:23.430902 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Getting quotas for user 18261f10678a4ce99626794c39bb5d7f and project f4aa8aab8447434b8619c3b7bb0b585a. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:42:23.481824 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Going to run 1 instances... {{(pid=124069) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:42:23.492464 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:42:23.503428 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1dd39897-e92d-4e4e-9007-e554fc175459 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:23.521649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1dd39897-e92d-4e4e-9007-e554fc175459 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1314 microversion: 2.1 time: 0.503409 Jun 14 19:42:23.540686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 37/59] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:23 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:23.547800 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-807016894", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "810afb1c-546b-4676-b2eb-077f19735ed6"}], "security_groups": [{"name": "tempest-securitygroup--714478376"}], "key_name": "tempest-keypair-137193103", "user_data": "}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:23.606150 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b8586104-5c25-4f83-b9e5-5ee35652abfa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.476759 Jun 14 19:42:23.614141 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 23/60] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:42:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 3485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:42:23.625907 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-bf359631-939b-4228-b9f1-4daee2f07c33 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:23.626463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-bf359631-939b-4228-b9f1-4daee2f07c33 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:23.641056 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bf359631-939b-4228-b9f1-4daee2f07c33 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:23.642839 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bf359631-939b-4228-b9f1-4daee2f07c33 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:23.643963 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bf359631-939b-4228-b9f1-4daee2f07c33 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:23.644718 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bf359631-939b-4228-b9f1-4daee2f07c33 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:23.867657 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.network.neutron [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] validate_networks() for [('810afb1c-546b-4676-b2eb-077f19735ed6', None, None, None, None, None)] {{(pid=124068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:42:23.889213 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-bf359631-939b-4228-b9f1-4daee2f07c33 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:23.914671 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-bf359631-939b-4228-b9f1-4daee2f07c33 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1225 microversion: 2.1 time: 0.299347 Jun 14 19:42:23.926782 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 24/61] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:23 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1225 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:23.937704 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-00bcdc9a-da57-47c8-b9b1-6528be6f51d4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:23.938364 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-00bcdc9a-da57-47c8-b9b1-6528be6f51d4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:24.154296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-00bcdc9a-da57-47c8-b9b1-6528be6f51d4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:24.178409 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-00bcdc9a-da57-47c8-b9b1-6528be6f51d4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1237 microversion: 2.1 time: 0.250425 Jun 14 19:42:24.184863 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 25/62] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:23 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1237 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:24.216415 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-405699a8-79e9-4bb4-b0ed-8500b40a139e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:24.224339 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-405699a8-79e9-4bb4-b0ed-8500b40a139e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:24.253974 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-405699a8-79e9-4bb4-b0ed-8500b40a139e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:24.259285 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-405699a8-79e9-4bb4-b0ed-8500b40a139e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:24.262433 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-405699a8-79e9-4bb4-b0ed-8500b40a139e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:24.265241 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-405699a8-79e9-4bb4-b0ed-8500b40a139e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:25.273590 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-405699a8-79e9-4bb4-b0ed-8500b40a139e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:25.297639 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-405699a8-79e9-4bb4-b0ed-8500b40a139e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:25.303306 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-405699a8-79e9-4bb4-b0ed-8500b40a139e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:25.307704 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-405699a8-79e9-4bb4-b0ed-8500b40a139e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1407 microversion: 2.20 time: 1.108045 Jun 14 19:42:25.310384 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 26/63] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:24 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1407 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:25.333254 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-3d2bf9ac-a2b2-47b5-b56e-84bc9b0478af tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:25.333932 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-3d2bf9ac-a2b2-47b5-b56e-84bc9b0478af tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:25.357271 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3d2bf9ac-a2b2-47b5-b56e-84bc9b0478af tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:25.358010 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3d2bf9ac-a2b2-47b5-b56e-84bc9b0478af tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:25.361126 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3d2bf9ac-a2b2-47b5-b56e-84bc9b0478af tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:25.361616 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3d2bf9ac-a2b2-47b5-b56e-84bc9b0478af tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:25.717043 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Flavor limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:42:25.717650 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Image limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:42:25.718002 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Flavor pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:42:25.718410 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Image pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:42:25.718811 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:42:25.734700 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:25.736953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:25.739344 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:25.748917 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:25.844580 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:42:25.858660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:25.866636 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for user 323c51f037db4ecca2f66cb6e9879246 and project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:42:25.905411 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Going to run 1 instances... {{(pid=124068) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:42:25.912002 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:42:26.062572 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-5bd8cf0a-2eab-4da6-88d6-7a7b6cfdf24e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.520493 Jun 14 19:42:26.063227 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 38/64] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:42:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 2522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:42:26.415964 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-3d2bf9ac-a2b2-47b5-b56e-84bc9b0478af tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:26.424610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-3d2bf9ac-a2b2-47b5-b56e-84bc9b0478af tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1314 microversion: 2.1 time: 1.112582 Jun 14 19:42:26.425188 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 27/65] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:25 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1314 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:26.438176 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-0eb32a09-9844-4e84-bfa3-ae5e30dda472 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:26.456533 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-0eb32a09-9844-4e84-bfa3-ae5e30dda472 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:26.473681 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0eb32a09-9844-4e84-bfa3-ae5e30dda472 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:26.474477 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0eb32a09-9844-4e84-bfa3-ae5e30dda472 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:26.475589 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0eb32a09-9844-4e84-bfa3-ae5e30dda472 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:26.477094 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0eb32a09-9844-4e84-bfa3-ae5e30dda472 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:26.509212 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-3ddb73c1-6b9f-4f6e-b2c9-d03cd534de25 req-410a625b-8334-40c2-9400-24f201e7e866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f063e7ec-ffab-48c6-b145-f51cd09dd5f4", "name": "network-vif-plugged", "status": "completed", "tag": "f795a935-08ef-44b7-807d-5af2326db545"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:26.542590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-3ddb73c1-6b9f-4f6e-b2c9-d03cd534de25 req-410a625b-8334-40c2-9400-24f201e7e866 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:26.550826 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-3ddb73c1-6b9f-4f6e-b2c9-d03cd534de25 req-410a625b-8334-40c2-9400-24f201e7e866 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:26.585497 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-3ddb73c1-6b9f-4f6e-b2c9-d03cd534de25 req-410a625b-8334-40c2-9400-24f201e7e866 service nova] Creating event network-vif-plugged:f795a935-08ef-44b7-807d-5af2326db545 for instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 on hv-cinder-84580 Jun 14 19:42:26.586388 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-3ddb73c1-6b9f-4f6e-b2c9-d03cd534de25 req-410a625b-8334-40c2-9400-24f201e7e866 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124068) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 14 19:42:26.587838 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a520937e-7f4f-4fa0-b828-f02abfef33b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:26.589216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a520937e-7f4f-4fa0-b828-f02abfef33b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:26.590521 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a520937e-7f4f-4fa0-b828-f02abfef33b2 None None] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:26.591194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a520937e-7f4f-4fa0-b828-f02abfef33b2 None None] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:26.602634 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.compute.rpcapi [None req-a520937e-7f4f-4fa0-b828-f02abfef33b2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 14 19:42:26.603866 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a520937e-7f4f-4fa0-b828-f02abfef33b2 None None] Releasing lock "compute-rpcapi-router" {{(pid=124068) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 14 19:42:26.638596 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a520937e-7f4f-4fa0-b828-f02abfef33b2 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.573498 Jun 14 19:42:26.645349 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 39/66] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:42:26.673614 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4743561a-7f71-4f63-89c9-f8644c44f253 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:26.679019 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4743561a-7f71-4f63-89c9-f8644c44f253 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:26.708037 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4743561a-7f71-4f63-89c9-f8644c44f253 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:26.709945 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4743561a-7f71-4f63-89c9-f8644c44f253 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:26.712857 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4743561a-7f71-4f63-89c9-f8644c44f253 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:26.723844 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4743561a-7f71-4f63-89c9-f8644c44f253 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:26.996092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4743561a-7f71-4f63-89c9-f8644c44f253 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:27.006268 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4743561a-7f71-4f63-89c9-f8644c44f253 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1295 microversion: 2.1 time: 0.354212 Jun 14 19:42:27.007591 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 40/67] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:26 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1295 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:27.014547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a911b90e-b3b8-44df-aacf-a72d352ab7cf tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:27.015377 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a911b90e-b3b8-44df-aacf-a72d352ab7cf tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:27.033160 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-0eb32a09-9844-4e84-bfa3-ae5e30dda472 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:27.048164 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-0eb32a09-9844-4e84-bfa3-ae5e30dda472 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1279 microversion: 2.1 time: 0.611782 Jun 14 19:42:27.051168 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 28/68] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:26 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1279 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:27.067007 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9b8458be-29ff-468c-8137-a3f3bc0a0804 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:27.068476 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9b8458be-29ff-468c-8137-a3f3bc0a0804 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:27.094200 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9b8458be-29ff-468c-8137-a3f3bc0a0804 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:27.095084 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9b8458be-29ff-468c-8137-a3f3bc0a0804 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:27.096622 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9b8458be-29ff-468c-8137-a3f3bc0a0804 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:27.097323 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9b8458be-29ff-468c-8137-a3f3bc0a0804 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:27.130237 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a911b90e-b3b8-44df-aacf-a72d352ab7cf tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:27.140974 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a911b90e-b3b8-44df-aacf-a72d352ab7cf tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1240 microversion: 2.1 time: 0.131905 Jun 14 19:42:27.142040 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 41/69] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:27 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1240 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:27.444027 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-20670bbe-de1c-4d28-8896-1521aee0a4c5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:27.445004 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-20670bbe-de1c-4d28-8896-1521aee0a4c5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:27.459707 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-20670bbe-de1c-4d28-8896-1521aee0a4c5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:27.462824 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-20670bbe-de1c-4d28-8896-1521aee0a4c5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:27.465951 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-20670bbe-de1c-4d28-8896-1521aee0a4c5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:27.468538 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-20670bbe-de1c-4d28-8896-1521aee0a4c5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:27.675272 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9b8458be-29ff-468c-8137-a3f3bc0a0804 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:27.707147 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9b8458be-29ff-468c-8137-a3f3bc0a0804 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:27.717904 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9b8458be-29ff-468c-8137-a3f3bc0a0804 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:27.721685 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9b8458be-29ff-468c-8137-a3f3bc0a0804 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1407 microversion: 2.20 time: 0.668867 Jun 14 19:42:27.724322 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 29/70] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:27 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1407 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:28.026776 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-718d98d6-8dfd-4903-86c8-99d21b7a68ed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:28.027836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-718d98d6-8dfd-4903-86c8-99d21b7a68ed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:28.049942 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-718d98d6-8dfd-4903-86c8-99d21b7a68ed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:28.051707 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-718d98d6-8dfd-4903-86c8-99d21b7a68ed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:28.059043 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-718d98d6-8dfd-4903-86c8-99d21b7a68ed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:28.059590 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-718d98d6-8dfd-4903-86c8-99d21b7a68ed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:28.189151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-20670bbe-de1c-4d28-8896-1521aee0a4c5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:28.209460 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-20670bbe-de1c-4d28-8896-1521aee0a4c5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1314 microversion: 2.1 time: 0.771004 Jun 14 19:42:28.213133 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 42/71] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:27 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:28.225797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3c92a94a-c450-46e6-bd8a-c7836fcf3980 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:28.226440 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3c92a94a-c450-46e6-bd8a-c7836fcf3980 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:28.242062 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3c92a94a-c450-46e6-bd8a-c7836fcf3980 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:28.242779 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3c92a94a-c450-46e6-bd8a-c7836fcf3980 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:28.244177 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3c92a94a-c450-46e6-bd8a-c7836fcf3980 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:28.245846 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3c92a94a-c450-46e6-bd8a-c7836fcf3980 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:28.373477 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-718d98d6-8dfd-4903-86c8-99d21b7a68ed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:28.385917 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-718d98d6-8dfd-4903-86c8-99d21b7a68ed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1295 microversion: 2.1 time: 0.361308 Jun 14 19:42:28.388642 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 30/72] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:28 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1295 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:28.394523 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2fc87850-2816-4bad-9d2b-e8e05afb1b0a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:28.395146 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2fc87850-2816-4bad-9d2b-e8e05afb1b0a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:28.402081 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2fc87850-2816-4bad-9d2b-e8e05afb1b0a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:28.402536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2fc87850-2816-4bad-9d2b-e8e05afb1b0a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:28.403341 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2fc87850-2816-4bad-9d2b-e8e05afb1b0a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:28.403776 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2fc87850-2816-4bad-9d2b-e8e05afb1b0a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:28.497971 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2fc87850-2816-4bad-9d2b-e8e05afb1b0a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:28.508303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2fc87850-2816-4bad-9d2b-e8e05afb1b0a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1298 microversion: 2.1 time: 0.117668 Jun 14 19:42:28.509318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 31/73] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:28 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1298 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:28.742757 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-cfebf433-14aa-497d-bccf-d5662e6e994e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:28.743352 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-cfebf433-14aa-497d-bccf-d5662e6e994e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:28.771250 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cfebf433-14aa-497d-bccf-d5662e6e994e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:28.771780 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cfebf433-14aa-497d-bccf-d5662e6e994e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:28.777815 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cfebf433-14aa-497d-bccf-d5662e6e994e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:28.780219 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cfebf433-14aa-497d-bccf-d5662e6e994e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:29.045734 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3c92a94a-c450-46e6-bd8a-c7836fcf3980 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:29.052531 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=65 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:29.056723 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3c92a94a-c450-46e6-bd8a-c7836fcf3980 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.839813 Jun 14 19:42:29.074233 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 43/74] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:28 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:29.087371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-bc19a5b6-e413-4193-9866-1bb0ae094937 req-5be3fa00-3196-4ba0-9aea-524004a75ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2d9ed3-941a-496c-b3c8-a9a5648cd846", "tag": "5445a8aa-6257-4a17-8a1b-eff254fa9a9d"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:29.104083 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-bc19a5b6-e413-4193-9866-1bb0ae094937 req-5be3fa00-3196-4ba0-9aea-524004a75ca0 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:29.114198 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-bc19a5b6-e413-4193-9866-1bb0ae094937 req-5be3fa00-3196-4ba0-9aea-524004a75ca0 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:29.134560 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-bc19a5b6-e413-4193-9866-1bb0ae094937 req-5be3fa00-3196-4ba0-9aea-524004a75ca0 service nova] Creating event network-changed:5445a8aa-6257-4a17-8a1b-eff254fa9a9d for instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 on hv-cinder-84580 Jun 14 19:42:29.148100 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-bc19a5b6-e413-4193-9866-1bb0ae094937 req-5be3fa00-3196-4ba0-9aea-524004a75ca0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072633 Jun 14 19:42:29.153199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 44/75] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:42:29.231195 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-2e18e2d3-b8cc-4cfb-be0f-026a29150e4a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:29.231897 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-2e18e2d3-b8cc-4cfb-be0f-026a29150e4a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:29.242928 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2e18e2d3-b8cc-4cfb-be0f-026a29150e4a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:29.253827 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2e18e2d3-b8cc-4cfb-be0f-026a29150e4a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:29.254772 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2e18e2d3-b8cc-4cfb-be0f-026a29150e4a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:29.255219 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2e18e2d3-b8cc-4cfb-be0f-026a29150e4a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:29.349839 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-cfebf433-14aa-497d-bccf-d5662e6e994e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:29.360057 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-cfebf433-14aa-497d-bccf-d5662e6e994e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:29.363787 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-cfebf433-14aa-497d-bccf-d5662e6e994e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:29.364989 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-cfebf433-14aa-497d-bccf-d5662e6e994e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1407 microversion: 2.20 time: 0.626504 Jun 14 19:42:29.366745 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 32/76] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:28 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1407 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:42:29.400505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-0c49e804-d825-444b-854b-e7cbbbfc7e80 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:29.401714 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-0c49e804-d825-444b-854b-e7cbbbfc7e80 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:29.412629 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c49e804-d825-444b-854b-e7cbbbfc7e80 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:29.419669 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c49e804-d825-444b-854b-e7cbbbfc7e80 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:29.420970 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c49e804-d825-444b-854b-e7cbbbfc7e80 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:29.421612 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c49e804-d825-444b-854b-e7cbbbfc7e80 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:29.902719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-0c49e804-d825-444b-854b-e7cbbbfc7e80 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:29.912524 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-0c49e804-d825-444b-854b-e7cbbbfc7e80 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1362 microversion: 2.1 time: 0.516056 Jun 14 19:42:29.917576 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 33/77] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:29 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1362 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:29.927195 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-091a95c4-e629-4953-9e42-a5f9691a832d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:29.933262 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-091a95c4-e629-4953-9e42-a5f9691a832d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:29.947419 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-091a95c4-e629-4953-9e42-a5f9691a832d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:29.948902 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-091a95c4-e629-4953-9e42-a5f9691a832d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:29.949901 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-091a95c4-e629-4953-9e42-a5f9691a832d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:29.950340 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-091a95c4-e629-4953-9e42-a5f9691a832d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:30.175424 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-091a95c4-e629-4953-9e42-a5f9691a832d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:30.205737 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-091a95c4-e629-4953-9e42-a5f9691a832d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1298 microversion: 2.1 time: 0.285404 Jun 14 19:42:30.208092 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 34/78] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:29 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1298 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:30.221575 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-44de5c5c-ba5e-4907-a33a-7dd9bb4537e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:30.222583 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-44de5c5c-ba5e-4907-a33a-7dd9bb4537e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:30.239941 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-44de5c5c-ba5e-4907-a33a-7dd9bb4537e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:30.246071 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-44de5c5c-ba5e-4907-a33a-7dd9bb4537e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:30.247975 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-44de5c5c-ba5e-4907-a33a-7dd9bb4537e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:30.250200 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-44de5c5c-ba5e-4907-a33a-7dd9bb4537e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:30.565102 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-44de5c5c-ba5e-4907-a33a-7dd9bb4537e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:30.575082 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-44de5c5c-ba5e-4907-a33a-7dd9bb4537e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.364959 Jun 14 19:42:30.576382 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 35/79] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:30 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:30.588865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-34c0a074-173d-4078-903b-566e3fbe738b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:30.589753 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-34c0a074-173d-4078-903b-566e3fbe738b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:30.596836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-34c0a074-173d-4078-903b-566e3fbe738b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:30.597557 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-34c0a074-173d-4078-903b-566e3fbe738b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:30.598766 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-34c0a074-173d-4078-903b-566e3fbe738b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:30.599475 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-34c0a074-173d-4078-903b-566e3fbe738b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:30.603382 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-2e18e2d3-b8cc-4cfb-be0f-026a29150e4a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:30.616640 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-2e18e2d3-b8cc-4cfb-be0f-026a29150e4a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1314 microversion: 2.1 time: 1.387599 Jun 14 19:42:30.620909 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 45/80] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:29 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1314 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:30.792862 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-34c0a074-173d-4078-903b-566e3fbe738b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:30.802723 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-34c0a074-173d-4078-903b-566e3fbe738b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:30.805124 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-34c0a074-173d-4078-903b-566e3fbe738b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:30.806512 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-34c0a074-173d-4078-903b-566e3fbe738b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1407 microversion: 2.20 time: 0.229040 Jun 14 19:42:30.807672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 36/81] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:30 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:30.935990 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-ae2fd75a-d16b-4f30-9079-9b84f3d54d66 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:30.936846 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-ae2fd75a-d16b-4f30-9079-9b84f3d54d66 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:30.944380 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ae2fd75a-d16b-4f30-9079-9b84f3d54d66 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:30.945196 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ae2fd75a-d16b-4f30-9079-9b84f3d54d66 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:30.946008 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ae2fd75a-d16b-4f30-9079-9b84f3d54d66 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:30.946439 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ae2fd75a-d16b-4f30-9079-9b84f3d54d66 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:31.225736 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-42eaed2a-b2f3-41a1-a000-3afd023755ba tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:31.227129 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-42eaed2a-b2f3-41a1-a000-3afd023755ba tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:31.238275 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-42eaed2a-b2f3-41a1-a000-3afd023755ba tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:31.242355 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-42eaed2a-b2f3-41a1-a000-3afd023755ba tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:31.246496 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-42eaed2a-b2f3-41a1-a000-3afd023755ba tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:31.247362 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-42eaed2a-b2f3-41a1-a000-3afd023755ba tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:31.372548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-42eaed2a-b2f3-41a1-a000-3afd023755ba tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:31.382170 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-42eaed2a-b2f3-41a1-a000-3afd023755ba tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1298 microversion: 2.1 time: 0.161374 Jun 14 19:42:31.383325 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 37/82] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:31 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1298 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:31.389881 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-e3e8fe8a-2d2a-4677-a4e7-7440a9513efe req-3765b3ad-68ec-45b9-b432-d23a4d3f5ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26a2c03a-7157-4585-b388-ae3fbf9913cb", "tag": "e694d355-bb65-4972-b8bc-9554650ef1ff"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:31.402006 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-e3e8fe8a-2d2a-4677-a4e7-7440a9513efe req-3765b3ad-68ec-45b9-b432-d23a4d3f5ab5 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:31.402974 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-e3e8fe8a-2d2a-4677-a4e7-7440a9513efe req-3765b3ad-68ec-45b9-b432-d23a4d3f5ab5 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:31.418446 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-e3e8fe8a-2d2a-4677-a4e7-7440a9513efe req-3765b3ad-68ec-45b9-b432-d23a4d3f5ab5 service nova] Creating event network-changed:e694d355-bb65-4972-b8bc-9554650ef1ff for instance 26a2c03a-7157-4585-b388-ae3fbf9913cb on hv-cinder-84580 Jun 14 19:42:31.424501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-e3e8fe8a-2d2a-4677-a4e7-7440a9513efe req-3765b3ad-68ec-45b9-b432-d23a4d3f5ab5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038519 Jun 14 19:42:31.426042 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 38/83] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:42:31.593217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ac036a75-f67f-4e6d-be04-4da88a62c4aa tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:31.593966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ac036a75-f67f-4e6d-be04-4da88a62c4aa tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:31.604948 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ac036a75-f67f-4e6d-be04-4da88a62c4aa tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:31.605438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ac036a75-f67f-4e6d-be04-4da88a62c4aa tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:31.606234 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ac036a75-f67f-4e6d-be04-4da88a62c4aa tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:31.606669 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ac036a75-f67f-4e6d-be04-4da88a62c4aa tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:31.640717 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ae2fd75a-d16b-4f30-9079-9b84f3d54d66 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:31.656840 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-ae2fd75a-d16b-4f30-9079-9b84f3d54d66 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1362 microversion: 2.1 time: 0.724354 Jun 14 19:42:31.658195 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 46/84] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:30 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1362 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:31.664525 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b2c979ce-f049-4236-95cd-1344e00a4686 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:31.665174 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b2c979ce-f049-4236-95cd-1344e00a4686 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:31.677055 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b2c979ce-f049-4236-95cd-1344e00a4686 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:31.677767 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b2c979ce-f049-4236-95cd-1344e00a4686 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:31.678843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b2c979ce-f049-4236-95cd-1344e00a4686 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:31.679503 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b2c979ce-f049-4236-95cd-1344e00a4686 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:31.835048 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-ac036a75-f67f-4e6d-be04-4da88a62c4aa tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:31.846129 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-ac036a75-f67f-4e6d-be04-4da88a62c4aa tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.257272 Jun 14 19:42:31.847747 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 39/85] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:31 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:31.852983 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-7db1fddb-8de5-48bc-a207-4380d2330cff tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:31.854043 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-7db1fddb-8de5-48bc-a207-4380d2330cff tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:31.863615 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7db1fddb-8de5-48bc-a207-4380d2330cff tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:31.864296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7db1fddb-8de5-48bc-a207-4380d2330cff tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:31.865803 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7db1fddb-8de5-48bc-a207-4380d2330cff tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:31.866729 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7db1fddb-8de5-48bc-a207-4380d2330cff tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:32.098143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-7db1fddb-8de5-48bc-a207-4380d2330cff tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:32.108672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-7db1fddb-8de5-48bc-a207-4380d2330cff tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:32.110288 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-7db1fddb-8de5-48bc-a207-4380d2330cff tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:32.112119 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-7db1fddb-8de5-48bc-a207-4380d2330cff tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1407 microversion: 2.20 time: 0.262803 Jun 14 19:42:32.112808 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 40/86] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:31 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:32.402196 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8331dcfe-f09e-4891-8d3b-1710cd441407 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:32.403719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8331dcfe-f09e-4891-8d3b-1710cd441407 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:32.410280 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8331dcfe-f09e-4891-8d3b-1710cd441407 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:32.410740 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8331dcfe-f09e-4891-8d3b-1710cd441407 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:32.411486 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8331dcfe-f09e-4891-8d3b-1710cd441407 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:32.412125 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8331dcfe-f09e-4891-8d3b-1710cd441407 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:32.507050 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b2c979ce-f049-4236-95cd-1344e00a4686 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:32.518912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b2c979ce-f049-4236-95cd-1344e00a4686 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1499 microversion: 2.1 time: 0.858962 Jun 14 19:42:32.519765 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 47/87] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:31 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1499 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:32.673468 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8331dcfe-f09e-4891-8d3b-1710cd441407 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:32.677585 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=100 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:32.678596 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-036fbb34-4ecd-4274-9a15-1e0fc2d4b4e0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:32.679210 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-036fbb34-4ecd-4274-9a15-1e0fc2d4b4e0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:32.693686 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8331dcfe-f09e-4891-8d3b-1710cd441407 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1365 microversion: 2.1 time: 0.297014 Jun 14 19:42:32.694748 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 41/88] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:32 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:32.696382 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-036fbb34-4ecd-4274-9a15-1e0fc2d4b4e0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:32.696835 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-036fbb34-4ecd-4274-9a15-1e0fc2d4b4e0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:32.697821 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-036fbb34-4ecd-4274-9a15-1e0fc2d4b4e0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:32.698366 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-036fbb34-4ecd-4274-9a15-1e0fc2d4b4e0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:32.937073 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-c9137c93-ec32-45b7-b5f5-ad1072516999 req-e623eec4-c4b7-4888-8858-8b34f1754a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc5647b9-307a-4287-be2e-34a8aa3703ba", "tag": "8f6e7c67-b95a-4af1-86b0-33adfaffdfd6"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:32.948802 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-c9137c93-ec32-45b7-b5f5-ad1072516999 req-e623eec4-c4b7-4888-8858-8b34f1754a19 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:32.949302 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-c9137c93-ec32-45b7-b5f5-ad1072516999 req-e623eec4-c4b7-4888-8858-8b34f1754a19 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:32.965826 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-c9137c93-ec32-45b7-b5f5-ad1072516999 req-e623eec4-c4b7-4888-8858-8b34f1754a19 service nova] Creating event network-changed:8f6e7c67-b95a-4af1-86b0-33adfaffdfd6 for instance bc5647b9-307a-4287-be2e-34a8aa3703ba on hv-cinder-84580 Jun 14 19:42:32.972957 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-c9137c93-ec32-45b7-b5f5-ad1072516999 req-e623eec4-c4b7-4888-8858-8b34f1754a19 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157438 Jun 14 19:42:32.974749 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 42/89] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:42:32.993893 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-61b06e2e-bd87-4d2b-ba09-8201a03be511 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:33.000387 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-61b06e2e-bd87-4d2b-ba09-8201a03be511 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:33.016419 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-61b06e2e-bd87-4d2b-ba09-8201a03be511 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:33.017003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-61b06e2e-bd87-4d2b-ba09-8201a03be511 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:33.017798 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-61b06e2e-bd87-4d2b-ba09-8201a03be511 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:33.023138 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-61b06e2e-bd87-4d2b-ba09-8201a03be511 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:33.070465 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-036fbb34-4ecd-4274-9a15-1e0fc2d4b4e0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:33.084854 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-036fbb34-4ecd-4274-9a15-1e0fc2d4b4e0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1362 microversion: 2.1 time: 0.408131 Jun 14 19:42:33.085475 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 48/90] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:32 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:33.137343 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b59c9497-3449-4e9c-9fd6-90033a57d2e2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:33.143047 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b59c9497-3449-4e9c-9fd6-90033a57d2e2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:33.167155 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b59c9497-3449-4e9c-9fd6-90033a57d2e2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:33.167990 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b59c9497-3449-4e9c-9fd6-90033a57d2e2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:33.171168 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b59c9497-3449-4e9c-9fd6-90033a57d2e2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:33.171828 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b59c9497-3449-4e9c-9fd6-90033a57d2e2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:33.381125 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:33.480402 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-61b06e2e-bd87-4d2b-ba09-8201a03be511 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:33.491348 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-61b06e2e-bd87-4d2b-ba09-8201a03be511 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.515007 Jun 14 19:42:33.492298 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 43/91] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:32 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:33.559616 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b59c9497-3449-4e9c-9fd6-90033a57d2e2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:33.568033 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b59c9497-3449-4e9c-9fd6-90033a57d2e2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:33.569615 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b59c9497-3449-4e9c-9fd6-90033a57d2e2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:33.570951 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b59c9497-3449-4e9c-9fd6-90033a57d2e2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1407 microversion: 2.20 time: 0.444382 Jun 14 19:42:33.571534 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 49/92] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:33 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:42:33.712161 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-998836ff-3df3-4734-9ab8-a0f1ba5fd504 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:33.713928 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-998836ff-3df3-4734-9ab8-a0f1ba5fd504 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:33.721544 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-998836ff-3df3-4734-9ab8-a0f1ba5fd504 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:33.722291 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-998836ff-3df3-4734-9ab8-a0f1ba5fd504 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:33.723299 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-998836ff-3df3-4734-9ab8-a0f1ba5fd504 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:33.724094 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-998836ff-3df3-4734-9ab8-a0f1ba5fd504 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:33.936083 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-998836ff-3df3-4734-9ab8-a0f1ba5fd504 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:33.949033 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-998836ff-3df3-4734-9ab8-a0f1ba5fd504 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1365 microversion: 2.1 time: 0.241935 Jun 14 19:42:33.949871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 44/93] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:33 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:34.105022 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4c4ba878-38c6-450b-b55c-1840ca7ed803 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:34.105689 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4c4ba878-38c6-450b-b55c-1840ca7ed803 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:34.117666 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4c4ba878-38c6-450b-b55c-1840ca7ed803 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:34.118108 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4c4ba878-38c6-450b-b55c-1840ca7ed803 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:34.119795 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4c4ba878-38c6-450b-b55c-1840ca7ed803 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:34.120020 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4c4ba878-38c6-450b-b55c-1840ca7ed803 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:34.318889 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8e845ab3-f8db-462a-8948-0f7c0893d328 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91559056-aaca-434b-ae28-6aed704d5865"}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:34.320025 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8e845ab3-f8db-462a-8948-0f7c0893d328 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:34.325344 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=14 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:34.340474 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e845ab3-f8db-462a-8948-0f7c0893d328 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:34.340973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e845ab3-f8db-462a-8948-0f7c0893d328 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:34.347036 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e845ab3-f8db-462a-8948-0f7c0893d328 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:34.347529 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e845ab3-f8db-462a-8948-0f7c0893d328 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:35.056774 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4c4ba878-38c6-450b-b55c-1840ca7ed803 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:35.071780 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4c4ba878-38c6-450b-b55c-1840ca7ed803 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1362 microversion: 2.1 time: 0.971853 Jun 14 19:42:35.072450 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 50/94] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:34 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1362 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:35.077323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-8b4d1fad-de51-413a-92ac-40817b662a03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:35.078067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8b4d1fad-de51-413a-92ac-40817b662a03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:35.085509 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8b4d1fad-de51-413a-92ac-40817b662a03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:35.086185 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8b4d1fad-de51-413a-92ac-40817b662a03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:35.087503 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8b4d1fad-de51-413a-92ac-40817b662a03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:35.088152 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8b4d1fad-de51-413a-92ac-40817b662a03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:35.206474 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8e845ab3-f8db-462a-8948-0f7c0893d328 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "POST /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.891386 Jun 14 19:42:35.207441 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 45/95] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 14 19:42:34 2022] POST /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4/os-volume_attachments => generated 194 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:42:35.217341 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9527db8c-f423-414d-93a5-3cc91e404dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:35.218304 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9527db8c-f423-414d-93a5-3cc91e404dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:35.226140 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9527db8c-f423-414d-93a5-3cc91e404dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:35.226594 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9527db8c-f423-414d-93a5-3cc91e404dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:35.227425 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9527db8c-f423-414d-93a5-3cc91e404dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:35.227906 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9527db8c-f423-414d-93a5-3cc91e404dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:35.470930 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9527db8c-f423-414d-93a5-3cc91e404dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:35.471311 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-8b4d1fad-de51-413a-92ac-40817b662a03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:35.481954 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9527db8c-f423-414d-93a5-3cc91e404dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:35.484054 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9527db8c-f423-414d-93a5-3cc91e404dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:35.485085 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9527db8c-f423-414d-93a5-3cc91e404dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1407 microversion: 2.20 time: 0.275843 Jun 14 19:42:35.486107 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 46/96] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:35 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:35.488780 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-8b4d1fad-de51-413a-92ac-40817b662a03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.415069 Jun 14 19:42:35.489445 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 51/97] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:35 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:35.494059 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-14e4c7ee-d0a8-4cd1-a69c-610733a3a325 req-5e6fefa4-8a78-419a-b1ee-b181225185ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "519d4f97-34a0-4df8-85fe-98149ad589a8", "tag": "b72f1385-2205-4302-9798-d34c009e5cc2"}, {"name": "network-changed", "server_uuid": "f1434a82-cdbc-474b-95c4-44331ae4a084", "tag": "9ccf27ae-101e-466d-957e-384dd10e0dbb"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:35.496474 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-240a3105-701f-4466-a674-e9b26b502d70 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:35.497670 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-240a3105-701f-4466-a674-e9b26b502d70 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:35.506607 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-240a3105-701f-4466-a674-e9b26b502d70 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:35.507070 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-240a3105-701f-4466-a674-e9b26b502d70 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:35.507848 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-240a3105-701f-4466-a674-e9b26b502d70 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:35.508287 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-240a3105-701f-4466-a674-e9b26b502d70 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:35.515443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-14e4c7ee-d0a8-4cd1-a69c-610733a3a325 req-5e6fefa4-8a78-419a-b1ee-b181225185ef service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:35.516458 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-14e4c7ee-d0a8-4cd1-a69c-610733a3a325 req-5e6fefa4-8a78-419a-b1ee-b181225185ef service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:35.532951 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-14e4c7ee-d0a8-4cd1-a69c-610733a3a325 req-5e6fefa4-8a78-419a-b1ee-b181225185ef service nova] Creating event network-changed:b72f1385-2205-4302-9798-d34c009e5cc2 for instance 519d4f97-34a0-4df8-85fe-98149ad589a8 on hv-cinder-84580 Jun 14 19:42:35.533680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-14e4c7ee-d0a8-4cd1-a69c-610733a3a325 req-5e6fefa4-8a78-419a-b1ee-b181225185ef service nova] Creating event network-changed:9ccf27ae-101e-466d-957e-384dd10e0dbb for instance f1434a82-cdbc-474b-95c4-44331ae4a084 on hv-cinder-84580 Jun 14 19:42:35.551544 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-14e4c7ee-d0a8-4cd1-a69c-610733a3a325 req-5e6fefa4-8a78-419a-b1ee-b181225185ef service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.060604 Jun 14 19:42:35.564466 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 52/98] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:42:35.773190 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-240a3105-701f-4466-a674-e9b26b502d70 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:35.795369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-240a3105-701f-4466-a674-e9b26b502d70 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1365 microversion: 2.1 time: 0.307772 Jun 14 19:42:35.796973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 47/99] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:35 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:36.090451 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1cdb4014-a21e-4a00-a847-ff63ce40ea1c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:36.091188 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1cdb4014-a21e-4a00-a847-ff63ce40ea1c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:36.097296 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1cdb4014-a21e-4a00-a847-ff63ce40ea1c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:36.097816 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1cdb4014-a21e-4a00-a847-ff63ce40ea1c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:36.098586 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1cdb4014-a21e-4a00-a847-ff63ce40ea1c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:36.099024 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1cdb4014-a21e-4a00-a847-ff63ce40ea1c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:36.240422 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1cdb4014-a21e-4a00-a847-ff63ce40ea1c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:36.248366 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1cdb4014-a21e-4a00-a847-ff63ce40ea1c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1362 microversion: 2.1 time: 0.162515 Jun 14 19:42:36.249032 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 53/100] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:36 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:36.503484 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-dc95fefd-84c3-497b-8df2-daa05dd418b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:36.504084 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-dc95fefd-84c3-497b-8df2-daa05dd418b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:36.506004 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9e67979b-0f49-4d43-8318-0acf0bfe5f6d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:36.506623 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9e67979b-0f49-4d43-8318-0acf0bfe5f6d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:36.514412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9e67979b-0f49-4d43-8318-0acf0bfe5f6d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:36.514864 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9e67979b-0f49-4d43-8318-0acf0bfe5f6d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:36.515928 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9e67979b-0f49-4d43-8318-0acf0bfe5f6d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:36.516533 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9e67979b-0f49-4d43-8318-0acf0bfe5f6d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:36.517531 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dc95fefd-84c3-497b-8df2-daa05dd418b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:36.517986 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dc95fefd-84c3-497b-8df2-daa05dd418b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:36.518746 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dc95fefd-84c3-497b-8df2-daa05dd418b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:36.519173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dc95fefd-84c3-497b-8df2-daa05dd418b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:36.602146 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=10 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:36.952179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-dc95fefd-84c3-497b-8df2-daa05dd418b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:36.960666 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-dc95fefd-84c3-497b-8df2-daa05dd418b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:36.963520 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-dc95fefd-84c3-497b-8df2-daa05dd418b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:36.965214 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-dc95fefd-84c3-497b-8df2-daa05dd418b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1407 microversion: 2.20 time: 0.465396 Jun 14 19:42:36.965883 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 48/101] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:36 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:36.970615 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8d1fe604-b435-4833-8f93-6c8566a6d486 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:36.971450 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8d1fe604-b435-4833-8f93-6c8566a6d486 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:36.979573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8d1fe604-b435-4833-8f93-6c8566a6d486 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:36.980406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8d1fe604-b435-4833-8f93-6c8566a6d486 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:36.981505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8d1fe604-b435-4833-8f93-6c8566a6d486 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:36.982148 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8d1fe604-b435-4833-8f93-6c8566a6d486 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:37.065241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9e67979b-0f49-4d43-8318-0acf0bfe5f6d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:37.089090 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9e67979b-0f49-4d43-8318-0acf0bfe5f6d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.582194 Jun 14 19:42:37.089090 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 54/102] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:36 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:37.262978 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=32 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:37.267914 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9c68db89-bc7a-4cb3-84be-59075dea8a6a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:37.268722 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9c68db89-bc7a-4cb3-84be-59075dea8a6a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:37.281804 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c68db89-bc7a-4cb3-84be-59075dea8a6a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:37.283541 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c68db89-bc7a-4cb3-84be-59075dea8a6a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:37.285281 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c68db89-bc7a-4cb3-84be-59075dea8a6a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:37.286015 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c68db89-bc7a-4cb3-84be-59075dea8a6a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:37.289092 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8d1fe604-b435-4833-8f93-6c8566a6d486 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:37.310172 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8d1fe604-b435-4833-8f93-6c8566a6d486 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1365 microversion: 2.1 time: 0.342994 Jun 14 19:42:37.310767 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 49/103] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:36 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1365 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:37.860147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9c68db89-bc7a-4cb3-84be-59075dea8a6a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:37.871893 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9c68db89-bc7a-4cb3-84be-59075dea8a6a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1362 microversion: 2.1 time: 0.609789 Jun 14 19:42:37.881447 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 55/104] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:37 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1362 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:37.982989 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4b3e1cf3-8806-449b-a99b-51690cdc3c3c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:37.983695 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4b3e1cf3-8806-449b-a99b-51690cdc3c3c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:37.989770 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4b3e1cf3-8806-449b-a99b-51690cdc3c3c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:37.990221 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4b3e1cf3-8806-449b-a99b-51690cdc3c3c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:37.990982 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4b3e1cf3-8806-449b-a99b-51690cdc3c3c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:37.991418 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4b3e1cf3-8806-449b-a99b-51690cdc3c3c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:38.101983 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c7c7f1f3-ebf3-4f6d-ad69-2ea9cf850fc9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:38.102606 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c7c7f1f3-ebf3-4f6d-ad69-2ea9cf850fc9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:38.109583 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c7c7f1f3-ebf3-4f6d-ad69-2ea9cf850fc9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:38.110041 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c7c7f1f3-ebf3-4f6d-ad69-2ea9cf850fc9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:38.110861 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c7c7f1f3-ebf3-4f6d-ad69-2ea9cf850fc9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:38.111282 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c7c7f1f3-ebf3-4f6d-ad69-2ea9cf850fc9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:38.124173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4b3e1cf3-8806-449b-a99b-51690cdc3c3c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:38.133714 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4b3e1cf3-8806-449b-a99b-51690cdc3c3c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:38.135421 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4b3e1cf3-8806-449b-a99b-51690cdc3c3c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:38.136839 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4b3e1cf3-8806-449b-a99b-51690cdc3c3c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1407 microversion: 2.20 time: 0.157724 Jun 14 19:42:38.137911 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 50/105] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:37 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:38.251142 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c7c7f1f3-ebf3-4f6d-ad69-2ea9cf850fc9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:38.258427 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c7c7f1f3-ebf3-4f6d-ad69-2ea9cf850fc9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.161207 Jun 14 19:42:38.258986 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 56/106] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:38 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:38.327822 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6d258463-e5f2-46a2-b491-798b86ee5ccc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:38.328462 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-6d258463-e5f2-46a2-b491-798b86ee5ccc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:38.335694 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6d258463-e5f2-46a2-b491-798b86ee5ccc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:38.336213 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6d258463-e5f2-46a2-b491-798b86ee5ccc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:38.337055 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6d258463-e5f2-46a2-b491-798b86ee5ccc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:38.337595 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6d258463-e5f2-46a2-b491-798b86ee5ccc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:38.492199 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-6d258463-e5f2-46a2-b491-798b86ee5ccc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:38.500642 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6d258463-e5f2-46a2-b491-798b86ee5ccc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1365 microversion: 2.1 time: 0.176877 Jun 14 19:42:38.501223 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 51/107] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:38 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:38.889697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-fefafb0e-df8a-4a27-944c-9b66efb8b3d9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:38.890310 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-fefafb0e-df8a-4a27-944c-9b66efb8b3d9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:38.896301 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fefafb0e-df8a-4a27-944c-9b66efb8b3d9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:38.896920 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fefafb0e-df8a-4a27-944c-9b66efb8b3d9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:38.897703 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fefafb0e-df8a-4a27-944c-9b66efb8b3d9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:38.898133 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fefafb0e-df8a-4a27-944c-9b66efb8b3d9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:39.040877 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-fefafb0e-df8a-4a27-944c-9b66efb8b3d9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:39.049706 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-fefafb0e-df8a-4a27-944c-9b66efb8b3d9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1362 microversion: 2.1 time: 0.164597 Jun 14 19:42:39.050389 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 57/108] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:38 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:39.157159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-e32eea3b-9dc1-4419-bc1b-583fb3a50c20 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:39.158032 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-e32eea3b-9dc1-4419-bc1b-583fb3a50c20 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:39.164398 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e32eea3b-9dc1-4419-bc1b-583fb3a50c20 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:39.164901 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e32eea3b-9dc1-4419-bc1b-583fb3a50c20 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:39.165969 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e32eea3b-9dc1-4419-bc1b-583fb3a50c20 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:39.166535 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e32eea3b-9dc1-4419-bc1b-583fb3a50c20 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:39.278546 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-5585fb96-a2e3-4865-94cb-6700cd6595dc tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:39.279413 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-5585fb96-a2e3-4865-94cb-6700cd6595dc tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:39.291948 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5585fb96-a2e3-4865-94cb-6700cd6595dc tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:39.292704 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5585fb96-a2e3-4865-94cb-6700cd6595dc tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:39.293596 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5585fb96-a2e3-4865-94cb-6700cd6595dc tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:39.294152 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5585fb96-a2e3-4865-94cb-6700cd6595dc tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:39.347003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e32eea3b-9dc1-4419-bc1b-583fb3a50c20 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:39.356546 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e32eea3b-9dc1-4419-bc1b-583fb3a50c20 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:39.358334 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e32eea3b-9dc1-4419-bc1b-583fb3a50c20 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:39.360033 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-e32eea3b-9dc1-4419-bc1b-583fb3a50c20 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1407 microversion: 2.20 time: 0.207046 Jun 14 19:42:39.361087 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 52/109] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:39 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:39.466146 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-5585fb96-a2e3-4865-94cb-6700cd6595dc tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:39.474284 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-5585fb96-a2e3-4865-94cb-6700cd6595dc tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.201529 Jun 14 19:42:39.474864 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 58/110] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:39 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:39.517456 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-400e1ca0-e9c5-4751-a8db-3c6be7513c1e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:39.518178 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-400e1ca0-e9c5-4751-a8db-3c6be7513c1e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:39.524508 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-400e1ca0-e9c5-4751-a8db-3c6be7513c1e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:39.525053 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-400e1ca0-e9c5-4751-a8db-3c6be7513c1e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:39.525955 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-400e1ca0-e9c5-4751-a8db-3c6be7513c1e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:39.526522 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-400e1ca0-e9c5-4751-a8db-3c6be7513c1e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:39.606927 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-ce44b9c7-1e85-4026-9d12-7d4fca07318f req-cbf66c5a-6dc4-4ee4-9a23-f963bc877dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2d9ed3-941a-496c-b3c8-a9a5648cd846", "name": "network-vif-plugged", "status": "completed", "tag": "5445a8aa-6257-4a17-8a1b-eff254fa9a9d"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:39.624776 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-ce44b9c7-1e85-4026-9d12-7d4fca07318f req-cbf66c5a-6dc4-4ee4-9a23-f963bc877dd3 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:39.625323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-ce44b9c7-1e85-4026-9d12-7d4fca07318f req-cbf66c5a-6dc4-4ee4-9a23-f963bc877dd3 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:39.639588 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-ce44b9c7-1e85-4026-9d12-7d4fca07318f req-cbf66c5a-6dc4-4ee4-9a23-f963bc877dd3 service nova] Creating event network-vif-plugged:5445a8aa-6257-4a17-8a1b-eff254fa9a9d for instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 on hv-cinder-84580 Jun 14 19:42:39.647138 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-ce44b9c7-1e85-4026-9d12-7d4fca07318f req-cbf66c5a-6dc4-4ee4-9a23-f963bc877dd3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045112 Jun 14 19:42:39.648631 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 59/111] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:42:39.688330 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-400e1ca0-e9c5-4751-a8db-3c6be7513c1e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:39.696579 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-400e1ca0-e9c5-4751-a8db-3c6be7513c1e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1365 microversion: 2.1 time: 0.182961 Jun 14 19:42:39.699122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 53/112] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:39 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:40.068768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9fa67a4a-db82-4ac9-b4af-89da0e5844da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:40.069533 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9fa67a4a-db82-4ac9-b4af-89da0e5844da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:40.076631 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9fa67a4a-db82-4ac9-b4af-89da0e5844da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:40.077084 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9fa67a4a-db82-4ac9-b4af-89da0e5844da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:40.077883 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9fa67a4a-db82-4ac9-b4af-89da0e5844da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:40.078420 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9fa67a4a-db82-4ac9-b4af-89da0e5844da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:40.204843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9fa67a4a-db82-4ac9-b4af-89da0e5844da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:40.212161 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9fa67a4a-db82-4ac9-b4af-89da0e5844da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1362 microversion: 2.1 time: 0.147550 Jun 14 19:42:40.212772 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 60/113] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:40 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:40.378706 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6bb536d7-d691-4889-8783-a13589c827bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:40.379327 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-6bb536d7-d691-4889-8783-a13589c827bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:40.385647 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6bb536d7-d691-4889-8783-a13589c827bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:40.386098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6bb536d7-d691-4889-8783-a13589c827bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:40.386914 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6bb536d7-d691-4889-8783-a13589c827bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:40.387296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6bb536d7-d691-4889-8783-a13589c827bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:40.491242 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a2565d6c-ae2a-4d00-9350-b71842ad07f6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:40.491852 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a2565d6c-ae2a-4d00-9350-b71842ad07f6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:40.505665 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2565d6c-ae2a-4d00-9350-b71842ad07f6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:40.506112 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2565d6c-ae2a-4d00-9350-b71842ad07f6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:40.506872 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2565d6c-ae2a-4d00-9350-b71842ad07f6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:40.507298 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2565d6c-ae2a-4d00-9350-b71842ad07f6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:40.518800 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-6bb536d7-d691-4889-8783-a13589c827bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:40.526902 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-6bb536d7-d691-4889-8783-a13589c827bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:40.528410 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-6bb536d7-d691-4889-8783-a13589c827bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:40.529552 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6bb536d7-d691-4889-8783-a13589c827bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1407 microversion: 2.20 time: 0.154645 Jun 14 19:42:40.530117 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 54/114] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:40 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:40.716566 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-7aea422c-81da-4352-b069-8179ea870324 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:40.717088 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-7aea422c-81da-4352-b069-8179ea870324 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:40.723170 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7aea422c-81da-4352-b069-8179ea870324 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:40.723618 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7aea422c-81da-4352-b069-8179ea870324 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:40.724379 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7aea422c-81da-4352-b069-8179ea870324 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:40.724808 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7aea422c-81da-4352-b069-8179ea870324 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:40.815275 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a2565d6c-ae2a-4d00-9350-b71842ad07f6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:40.823206 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a2565d6c-ae2a-4d00-9350-b71842ad07f6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.335332 Jun 14 19:42:40.823782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 61/115] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:40 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:40.855806 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-7aea422c-81da-4352-b069-8179ea870324 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:40.863606 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-7aea422c-81da-4352-b069-8179ea870324 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1365 microversion: 2.1 time: 0.151636 Jun 14 19:42:40.864439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 55/116] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:40 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:41.228869 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-5bfd9cee-7c40-4c2a-8817-125368fa3ed9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:41.229496 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-5bfd9cee-7c40-4c2a-8817-125368fa3ed9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:41.235488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5bfd9cee-7c40-4c2a-8817-125368fa3ed9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:41.235936 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5bfd9cee-7c40-4c2a-8817-125368fa3ed9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:41.236690 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5bfd9cee-7c40-4c2a-8817-125368fa3ed9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:41.237122 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5bfd9cee-7c40-4c2a-8817-125368fa3ed9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:41.251735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=100 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:41.362356 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-5bfd9cee-7c40-4c2a-8817-125368fa3ed9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:41.369747 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-5bfd9cee-7c40-4c2a-8817-125368fa3ed9 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1362 microversion: 2.1 time: 0.144704 Jun 14 19:42:41.370317 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 62/117] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:41 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:41.547326 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6d871559-a7ea-4a68-8eb6-17f595b46e4b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:41.547933 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-6d871559-a7ea-4a68-8eb6-17f595b46e4b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:41.554378 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6d871559-a7ea-4a68-8eb6-17f595b46e4b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:41.554825 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6d871559-a7ea-4a68-8eb6-17f595b46e4b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:41.555577 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6d871559-a7ea-4a68-8eb6-17f595b46e4b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:41.556014 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6d871559-a7ea-4a68-8eb6-17f595b46e4b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:41.686824 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-6d871559-a7ea-4a68-8eb6-17f595b46e4b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:41.692054 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-9f96982b-1ffc-4a84-9ceb-589cc628c93d req-b8658239-19dd-4259-b185-80a6fea01efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a2c03a-7157-4585-b388-ae3fbf9913cb", "name": "network-vif-plugged", "status": "completed", "tag": "e694d355-bb65-4972-b8bc-9554650ef1ff"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:41.694823 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-6d871559-a7ea-4a68-8eb6-17f595b46e4b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:41.696313 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-6d871559-a7ea-4a68-8eb6-17f595b46e4b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:41.698027 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6d871559-a7ea-4a68-8eb6-17f595b46e4b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1407 microversion: 2.20 time: 0.153955 Jun 14 19:42:41.698969 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 56/118] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:41 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:41.700692 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-9f96982b-1ffc-4a84-9ceb-589cc628c93d req-b8658239-19dd-4259-b185-80a6fea01efe service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:41.701142 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-9f96982b-1ffc-4a84-9ceb-589cc628c93d req-b8658239-19dd-4259-b185-80a6fea01efe service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:41.711888 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-9f96982b-1ffc-4a84-9ceb-589cc628c93d req-b8658239-19dd-4259-b185-80a6fea01efe service nova] Creating event network-vif-plugged:e694d355-bb65-4972-b8bc-9554650ef1ff for instance 26a2c03a-7157-4585-b388-ae3fbf9913cb on hv-cinder-84580 Jun 14 19:42:41.716852 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-9f96982b-1ffc-4a84-9ceb-589cc628c93d req-b8658239-19dd-4259-b185-80a6fea01efe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028369 Jun 14 19:42:41.717450 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 63/119] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:42:41.840790 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-7d3f9386-28c4-4e5f-8aaa-4f8e9fa02c72 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:41.841454 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-7d3f9386-28c4-4e5f-8aaa-4f8e9fa02c72 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:41.847497 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7d3f9386-28c4-4e5f-8aaa-4f8e9fa02c72 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:41.847940 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7d3f9386-28c4-4e5f-8aaa-4f8e9fa02c72 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:41.848683 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7d3f9386-28c4-4e5f-8aaa-4f8e9fa02c72 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:41.849110 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7d3f9386-28c4-4e5f-8aaa-4f8e9fa02c72 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:41.880842 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-093b278f-2985-4d4a-b76e-3358eae3b5d1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:41.881683 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-093b278f-2985-4d4a-b76e-3358eae3b5d1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:41.888334 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-093b278f-2985-4d4a-b76e-3358eae3b5d1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:41.888789 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-093b278f-2985-4d4a-b76e-3358eae3b5d1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:41.889603 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-093b278f-2985-4d4a-b76e-3358eae3b5d1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:41.890049 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-093b278f-2985-4d4a-b76e-3358eae3b5d1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:41.989816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-7d3f9386-28c4-4e5f-8aaa-4f8e9fa02c72 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:41.992243 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:42.009594 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-7d3f9386-28c4-4e5f-8aaa-4f8e9fa02c72 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.164668 Jun 14 19:42:42.010416 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 57/120] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:41 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:42.037414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-093b278f-2985-4d4a-b76e-3358eae3b5d1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:42.045934 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-093b278f-2985-4d4a-b76e-3358eae3b5d1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1365 microversion: 2.1 time: 0.169271 Jun 14 19:42:42.046488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 64/121] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:41 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:42.389153 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ac0f6c3b-8109-42d8-ac79-efa3c1c6663a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:42.389835 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ac0f6c3b-8109-42d8-ac79-efa3c1c6663a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:42.399729 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ac0f6c3b-8109-42d8-ac79-efa3c1c6663a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:42.400185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ac0f6c3b-8109-42d8-ac79-efa3c1c6663a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:42.401638 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ac0f6c3b-8109-42d8-ac79-efa3c1c6663a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:42.402095 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ac0f6c3b-8109-42d8-ac79-efa3c1c6663a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:42.604614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-ac0f6c3b-8109-42d8-ac79-efa3c1c6663a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:42.612507 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-ac0f6c3b-8109-42d8-ac79-efa3c1c6663a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1362 microversion: 2.1 time: 0.230473 Jun 14 19:42:42.613304 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 58/122] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:42 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:42.716852 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-5ecfe64e-6914-4c8b-bb3b-ef25f063d180 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:42.717484 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-5ecfe64e-6914-4c8b-bb3b-ef25f063d180 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:42.723571 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5ecfe64e-6914-4c8b-bb3b-ef25f063d180 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:42.724024 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5ecfe64e-6914-4c8b-bb3b-ef25f063d180 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:42.724788 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5ecfe64e-6914-4c8b-bb3b-ef25f063d180 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:42.725222 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5ecfe64e-6914-4c8b-bb3b-ef25f063d180 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:42.852727 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-5ecfe64e-6914-4c8b-bb3b-ef25f063d180 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:42.861718 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-5ecfe64e-6914-4c8b-bb3b-ef25f063d180 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:42.863227 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-5ecfe64e-6914-4c8b-bb3b-ef25f063d180 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:42.864323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-5ecfe64e-6914-4c8b-bb3b-ef25f063d180 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1407 microversion: 2.20 time: 0.151964 Jun 14 19:42:42.864871 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 65/123] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:42 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:43.027850 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-465d8852-de2f-4678-b6f3-aacbe80e7f6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:43.028458 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-465d8852-de2f-4678-b6f3-aacbe80e7f6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:43.034991 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-465d8852-de2f-4678-b6f3-aacbe80e7f6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:43.035435 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-465d8852-de2f-4678-b6f3-aacbe80e7f6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:43.036190 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-465d8852-de2f-4678-b6f3-aacbe80e7f6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:43.036616 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-465d8852-de2f-4678-b6f3-aacbe80e7f6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:43.064808 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-794c6260-d8ee-4f8b-bf0e-78953786f91e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:43.065719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-794c6260-d8ee-4f8b-bf0e-78953786f91e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:43.073059 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-794c6260-d8ee-4f8b-bf0e-78953786f91e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:43.073615 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-794c6260-d8ee-4f8b-bf0e-78953786f91e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:43.074349 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-794c6260-d8ee-4f8b-bf0e-78953786f91e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:43.074791 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-794c6260-d8ee-4f8b-bf0e-78953786f91e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:43.186402 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-465d8852-de2f-4678-b6f3-aacbe80e7f6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:43.195567 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-465d8852-de2f-4678-b6f3-aacbe80e7f6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.172538 Jun 14 19:42:43.197940 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 59/124] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:43 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:43.214475 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-794c6260-d8ee-4f8b-bf0e-78953786f91e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:43.221770 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-794c6260-d8ee-4f8b-bf0e-78953786f91e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1365 microversion: 2.1 time: 0.162288 Jun 14 19:42:43.222341 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 66/125] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:43 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:43.632980 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-eb38f40c-48a1-45ea-ae46-6991ffa94ad2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:43.632980 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-eb38f40c-48a1-45ea-ae46-6991ffa94ad2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:43.640715 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eb38f40c-48a1-45ea-ae46-6991ffa94ad2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:43.641508 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eb38f40c-48a1-45ea-ae46-6991ffa94ad2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:43.642677 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eb38f40c-48a1-45ea-ae46-6991ffa94ad2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:43.643276 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eb38f40c-48a1-45ea-ae46-6991ffa94ad2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:43.797410 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-eb38f40c-48a1-45ea-ae46-6991ffa94ad2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:43.805241 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-eb38f40c-48a1-45ea-ae46-6991ffa94ad2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1362 microversion: 2.1 time: 0.178742 Jun 14 19:42:43.805861 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 60/126] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:43 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:43.884087 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d397ec29-b1ac-479f-991a-a6280046574b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:43.893719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d397ec29-b1ac-479f-991a-a6280046574b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:43.906453 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d397ec29-b1ac-479f-991a-a6280046574b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:43.907299 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d397ec29-b1ac-479f-991a-a6280046574b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:43.908367 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d397ec29-b1ac-479f-991a-a6280046574b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:43.908949 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d397ec29-b1ac-479f-991a-a6280046574b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:44.138831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d397ec29-b1ac-479f-991a-a6280046574b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:44.147451 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d397ec29-b1ac-479f-991a-a6280046574b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:44.148987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d397ec29-b1ac-479f-991a-a6280046574b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:44.150844 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d397ec29-b1ac-479f-991a-a6280046574b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1407 microversion: 2.20 time: 0.271360 Jun 14 19:42:44.151581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 67/127] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:43 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:44.181338 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-eeae564e-85fe-4f32-bafa-aa350876d1fa tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:44.181935 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-eeae564e-85fe-4f32-bafa-aa350876d1fa tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:44.188367 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eeae564e-85fe-4f32-bafa-aa350876d1fa tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:44.188909 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eeae564e-85fe-4f32-bafa-aa350876d1fa tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:44.189746 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eeae564e-85fe-4f32-bafa-aa350876d1fa tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:44.190204 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eeae564e-85fe-4f32-bafa-aa350876d1fa tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:44.214816 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-ba8fc4d0-fb6c-46ec-af3e-e474821fa771 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:44.215430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-ba8fc4d0-fb6c-46ec-af3e-e474821fa771 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:44.220645 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-eeae564e-85fe-4f32-bafa-aa350876d1fa tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Going to try to terminate instance {{(pid=124069) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:42:44.221806 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ba8fc4d0-fb6c-46ec-af3e-e474821fa771 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:44.222260 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ba8fc4d0-fb6c-46ec-af3e-e474821fa771 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:44.223033 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ba8fc4d0-fb6c-46ec-af3e-e474821fa771 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:44.223467 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ba8fc4d0-fb6c-46ec-af3e-e474821fa771 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:44.324744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:44.330548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-eeae564e-85fe-4f32-bafa-aa350876d1fa tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 204 len: 0 microversion: 2.1 time: 0.152881 Jun 14 19:42:44.331922 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 61/128] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:42:44 2022] DELETE /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:42:44.340059 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-74f836ec-0bcc-432d-b167-2884277bbde8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:44.342082 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-74f836ec-0bcc-432d-b167-2884277bbde8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:44.351734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-74f836ec-0bcc-432d-b167-2884277bbde8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:44.352441 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-74f836ec-0bcc-432d-b167-2884277bbde8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:44.353954 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-74f836ec-0bcc-432d-b167-2884277bbde8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:44.354955 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-74f836ec-0bcc-432d-b167-2884277bbde8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:44.394595 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ba8fc4d0-fb6c-46ec-af3e-e474821fa771 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:44.406418 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-ba8fc4d0-fb6c-46ec-af3e-e474821fa771 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.195466 Jun 14 19:42:44.407901 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 68/129] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:44 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:44.424691 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-83ef86ec-ef39-4026-8a44-aba23719ec7a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:44.425815 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-83ef86ec-ef39-4026-8a44-aba23719ec7a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:44.436319 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-83ef86ec-ef39-4026-8a44-aba23719ec7a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:44.437508 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-83ef86ec-ef39-4026-8a44-aba23719ec7a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:44.449878 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-83ef86ec-ef39-4026-8a44-aba23719ec7a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:44.450502 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-83ef86ec-ef39-4026-8a44-aba23719ec7a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:44.644066 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-74f836ec-0bcc-432d-b167-2884277bbde8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:44.652959 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-83ef86ec-ef39-4026-8a44-aba23719ec7a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:44.664334 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-74f836ec-0bcc-432d-b167-2884277bbde8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1365 microversion: 2.1 time: 0.329932 Jun 14 19:42:44.670801 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 62/130] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:44 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:44.685700 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-83ef86ec-ef39-4026-8a44-aba23719ec7a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1551 microversion: 2.1 time: 0.276543 Jun 14 19:42:44.686819 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 69/131] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:44 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1551 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:44.827920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-dae2affa-72eb-4693-a378-2b76d1c941e3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:44.840679 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-dae2affa-72eb-4693-a378-2b76d1c941e3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:44.855872 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dae2affa-72eb-4693-a378-2b76d1c941e3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:44.856585 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dae2affa-72eb-4693-a378-2b76d1c941e3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:44.857499 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dae2affa-72eb-4693-a378-2b76d1c941e3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:44.858050 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dae2affa-72eb-4693-a378-2b76d1c941e3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:44.910003 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-60e79002-d696-43b3-8eae-b63883bf636d req-ee8cb7dc-e8c0-4105-8a62-8f30f9149f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "519d4f97-34a0-4df8-85fe-98149ad589a8", "name": "network-vif-plugged", "status": "completed", "tag": "b72f1385-2205-4302-9798-d34c009e5cc2"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:44.921509 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-60e79002-d696-43b3-8eae-b63883bf636d req-ee8cb7dc-e8c0-4105-8a62-8f30f9149f61 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:44.922184 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-60e79002-d696-43b3-8eae-b63883bf636d req-ee8cb7dc-e8c0-4105-8a62-8f30f9149f61 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:44.935930 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-60e79002-d696-43b3-8eae-b63883bf636d req-ee8cb7dc-e8c0-4105-8a62-8f30f9149f61 service nova] Creating event network-vif-plugged:b72f1385-2205-4302-9798-d34c009e5cc2 for instance 519d4f97-34a0-4df8-85fe-98149ad589a8 on hv-cinder-84580 Jun 14 19:42:44.941962 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-60e79002-d696-43b3-8eae-b63883bf636d req-ee8cb7dc-e8c0-4105-8a62-8f30f9149f61 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035539 Jun 14 19:42:44.943597 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 70/132] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:42:45.039115 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-dae2affa-72eb-4693-a378-2b76d1c941e3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:45.051069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-dae2affa-72eb-4693-a378-2b76d1c941e3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1362 microversion: 2.1 time: 0.226748 Jun 14 19:42:45.061321 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 63/133] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:44 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:45.168587 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d0a93f51-e5c8-4cea-923a-dde83ffb84fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:45.169282 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d0a93f51-e5c8-4cea-923a-dde83ffb84fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:45.175878 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0a93f51-e5c8-4cea-923a-dde83ffb84fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:45.176278 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0a93f51-e5c8-4cea-923a-dde83ffb84fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:45.177039 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0a93f51-e5c8-4cea-923a-dde83ffb84fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:45.177506 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0a93f51-e5c8-4cea-923a-dde83ffb84fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:45.343617 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d0a93f51-e5c8-4cea-923a-dde83ffb84fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:45.355721 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d0a93f51-e5c8-4cea-923a-dde83ffb84fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:45.360896 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d0a93f51-e5c8-4cea-923a-dde83ffb84fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:45.364111 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d0a93f51-e5c8-4cea-923a-dde83ffb84fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1407 microversion: 2.20 time: 0.198090 Jun 14 19:42:45.365306 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 71/134] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:45 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:42:45.425354 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8c866122-9f4e-41e7-9531-28ebfbe60386 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:45.426038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8c866122-9f4e-41e7-9531-28ebfbe60386 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:45.434721 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8c866122-9f4e-41e7-9531-28ebfbe60386 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:45.435391 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8c866122-9f4e-41e7-9531-28ebfbe60386 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:45.437050 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8c866122-9f4e-41e7-9531-28ebfbe60386 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:45.437656 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8c866122-9f4e-41e7-9531-28ebfbe60386 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:45.601269 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8c866122-9f4e-41e7-9531-28ebfbe60386 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:45.610189 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8c866122-9f4e-41e7-9531-28ebfbe60386 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.190607 Jun 14 19:42:45.610769 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 64/135] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:45 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:45.682356 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-2648fb39-a75c-418e-9102-397bdecd2ab9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:45.683273 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-2648fb39-a75c-418e-9102-397bdecd2ab9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:45.689305 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2648fb39-a75c-418e-9102-397bdecd2ab9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:45.689982 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2648fb39-a75c-418e-9102-397bdecd2ab9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:45.690741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2648fb39-a75c-418e-9102-397bdecd2ab9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:45.691168 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2648fb39-a75c-418e-9102-397bdecd2ab9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:45.704641 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-0e5f9de3-f9e2-48be-afb8-04ee41635cb3 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:45.705354 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-0e5f9de3-f9e2-48be-afb8-04ee41635cb3 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:45.712946 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0e5f9de3-f9e2-48be-afb8-04ee41635cb3 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:45.713573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0e5f9de3-f9e2-48be-afb8-04ee41635cb3 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:45.714865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0e5f9de3-f9e2-48be-afb8-04ee41635cb3 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:45.715332 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0e5f9de3-f9e2-48be-afb8-04ee41635cb3 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:45.874156 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-2648fb39-a75c-418e-9102-397bdecd2ab9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:45.886270 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-2648fb39-a75c-418e-9102-397bdecd2ab9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1365 microversion: 2.1 time: 0.209005 Jun 14 19:42:45.896709 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 72/136] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:45 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:45.900053 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-0e5f9de3-f9e2-48be-afb8-04ee41635cb3 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:45.911073 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-0e5f9de3-f9e2-48be-afb8-04ee41635cb3 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1551 microversion: 2.1 time: 0.211989 Jun 14 19:42:45.912050 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 65/137] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:45 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1551 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:46.068322 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9e309460-0516-43b6-9704-767850be55da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:46.069008 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9e309460-0516-43b6-9704-767850be55da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:46.075747 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9e309460-0516-43b6-9704-767850be55da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:46.076190 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9e309460-0516-43b6-9704-767850be55da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:46.076970 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9e309460-0516-43b6-9704-767850be55da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:46.077399 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9e309460-0516-43b6-9704-767850be55da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:46.213723 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9e309460-0516-43b6-9704-767850be55da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:46.221308 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9e309460-0516-43b6-9704-767850be55da tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1362 microversion: 2.1 time: 0.156969 Jun 14 19:42:46.221905 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 73/138] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:46 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:46.383865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-3775bdc4-ebde-4e6c-a0d7-bdbf2e99ee77 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:46.385497 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-3775bdc4-ebde-4e6c-a0d7-bdbf2e99ee77 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:46.393205 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3775bdc4-ebde-4e6c-a0d7-bdbf2e99ee77 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:46.393899 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3775bdc4-ebde-4e6c-a0d7-bdbf2e99ee77 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:46.394870 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3775bdc4-ebde-4e6c-a0d7-bdbf2e99ee77 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:46.395483 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3775bdc4-ebde-4e6c-a0d7-bdbf2e99ee77 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:46.545934 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-3775bdc4-ebde-4e6c-a0d7-bdbf2e99ee77 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:46.555058 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-3775bdc4-ebde-4e6c-a0d7-bdbf2e99ee77 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:46.556699 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-3775bdc4-ebde-4e6c-a0d7-bdbf2e99ee77 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:46.558373 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-3775bdc4-ebde-4e6c-a0d7-bdbf2e99ee77 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1599 microversion: 2.20 time: 0.178516 Jun 14 19:42:46.558935 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 66/139] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:42:46 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:42:46.576694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f451db6c-1005-4978-9244-b71d1c55b436 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:46.577190 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f451db6c-1005-4978-9244-b71d1c55b436 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:46.583153 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f451db6c-1005-4978-9244-b71d1c55b436 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:46.583595 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f451db6c-1005-4978-9244-b71d1c55b436 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:46.584430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f451db6c-1005-4978-9244-b71d1c55b436 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:46.584851 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f451db6c-1005-4978-9244-b71d1c55b436 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:46.627270 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-bd832f7b-017b-42b3-9b38-c89eab1919e6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:46.628049 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-bd832f7b-017b-42b3-9b38-c89eab1919e6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:46.635746 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bd832f7b-017b-42b3-9b38-c89eab1919e6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:46.636308 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bd832f7b-017b-42b3-9b38-c89eab1919e6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:46.637113 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bd832f7b-017b-42b3-9b38-c89eab1919e6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:46.637832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bd832f7b-017b-42b3-9b38-c89eab1919e6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:46.739591 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f451db6c-1005-4978-9244-b71d1c55b436 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.166671 Jun 14 19:42:46.740340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 74/140] 10.222.0.44 () {60 vars in 1315 bytes} [Tue Jun 14 19:42:46 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:42:46.905590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4e57e132-06bc-4f53-8fb4-000c5f9ed92e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:46.906453 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4e57e132-06bc-4f53-8fb4-000c5f9ed92e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:46.918827 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4e57e132-06bc-4f53-8fb4-000c5f9ed92e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:46.919617 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4e57e132-06bc-4f53-8fb4-000c5f9ed92e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:46.920882 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4e57e132-06bc-4f53-8fb4-000c5f9ed92e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:46.921816 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4e57e132-06bc-4f53-8fb4-000c5f9ed92e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:47.023020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-bd832f7b-017b-42b3-9b38-c89eab1919e6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:47.034040 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-bd832f7b-017b-42b3-9b38-c89eab1919e6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.410011 Jun 14 19:42:47.034634 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 67/141] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:46 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:47.060283 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-59282b7d-fd89-4b7c-ab9a-2adc7df72bb5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:47.060897 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-59282b7d-fd89-4b7c-ab9a-2adc7df72bb5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:47.076621 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-59282b7d-fd89-4b7c-ab9a-2adc7df72bb5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:47.077073 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-59282b7d-fd89-4b7c-ab9a-2adc7df72bb5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:47.077892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-59282b7d-fd89-4b7c-ab9a-2adc7df72bb5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:47.078319 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-59282b7d-fd89-4b7c-ab9a-2adc7df72bb5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:47.148143 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4e57e132-06bc-4f53-8fb4-000c5f9ed92e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:47.161178 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4e57e132-06bc-4f53-8fb4-000c5f9ed92e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1365 microversion: 2.1 time: 0.258523 Jun 14 19:42:47.162048 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 75/142] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:46 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:47.170124 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-77f25577-44a6-4c80-bdd7-26264588f0ff req-7d979d39-c406-45e1-8790-69b4e3c5b4db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1434a82-cdbc-474b-95c4-44331ae4a084", "name": "network-vif-plugged", "status": "completed", "tag": "9ccf27ae-101e-466d-957e-384dd10e0dbb"}, {"server_uuid": "bc5647b9-307a-4287-be2e-34a8aa3703ba", "name": "network-vif-plugged", "status": "completed", "tag": "8f6e7c67-b95a-4af1-86b0-33adfaffdfd6"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:47.185202 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-77f25577-44a6-4c80-bdd7-26264588f0ff req-7d979d39-c406-45e1-8790-69b4e3c5b4db service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:47.185738 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-77f25577-44a6-4c80-bdd7-26264588f0ff req-7d979d39-c406-45e1-8790-69b4e3c5b4db service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:47.205150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-77f25577-44a6-4c80-bdd7-26264588f0ff req-7d979d39-c406-45e1-8790-69b4e3c5b4db service nova] Creating event network-vif-plugged:9ccf27ae-101e-466d-957e-384dd10e0dbb for instance f1434a82-cdbc-474b-95c4-44331ae4a084 on hv-cinder-84580 Jun 14 19:42:47.206142 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-77f25577-44a6-4c80-bdd7-26264588f0ff req-7d979d39-c406-45e1-8790-69b4e3c5b4db service nova] Creating event network-vif-plugged:8f6e7c67-b95a-4af1-86b0-33adfaffdfd6 for instance bc5647b9-307a-4287-be2e-34a8aa3703ba on hv-cinder-84580 Jun 14 19:42:47.215092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-77f25577-44a6-4c80-bdd7-26264588f0ff req-7d979d39-c406-45e1-8790-69b4e3c5b4db service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051521 Jun 14 19:42:47.216437 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 76/143] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:42:47.242207 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d1d520f3-edd2-4ba4-bee2-d7df97cf1406 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:47.247619 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d1d520f3-edd2-4ba4-bee2-d7df97cf1406 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:47.260692 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d1d520f3-edd2-4ba4-bee2-d7df97cf1406 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:47.262111 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d1d520f3-edd2-4ba4-bee2-d7df97cf1406 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:47.263778 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d1d520f3-edd2-4ba4-bee2-d7df97cf1406 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:47.264615 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d1d520f3-edd2-4ba4-bee2-d7df97cf1406 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:47.391148 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-59282b7d-fd89-4b7c-ab9a-2adc7df72bb5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:47.400455 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-59282b7d-fd89-4b7c-ab9a-2adc7df72bb5 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1551 microversion: 2.1 time: 0.354696 Jun 14 19:42:47.402003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 68/144] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:47 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1551 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:47.463197 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d1d520f3-edd2-4ba4-bee2-d7df97cf1406 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:47.472460 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d1d520f3-edd2-4ba4-bee2-d7df97cf1406 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1362 microversion: 2.1 time: 0.238256 Jun 14 19:42:47.483167 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 77/145] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:47 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:48.051191 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a461863e-8022-48bd-8d71-4de85fb4bb6e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:48.051920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a461863e-8022-48bd-8d71-4de85fb4bb6e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:48.076943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a461863e-8022-48bd-8d71-4de85fb4bb6e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:48.079193 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a461863e-8022-48bd-8d71-4de85fb4bb6e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:48.080371 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a461863e-8022-48bd-8d71-4de85fb4bb6e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:48.080904 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a461863e-8022-48bd-8d71-4de85fb4bb6e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:48.185278 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c091c320-4d55-4578-82a2-4ad72b67f77d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:48.186839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c091c320-4d55-4578-82a2-4ad72b67f77d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:48.214135 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c091c320-4d55-4578-82a2-4ad72b67f77d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:48.214727 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c091c320-4d55-4578-82a2-4ad72b67f77d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:48.215648 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c091c320-4d55-4578-82a2-4ad72b67f77d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:48.216173 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c091c320-4d55-4578-82a2-4ad72b67f77d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:48.559543 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a461863e-8022-48bd-8d71-4de85fb4bb6e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:48.563462 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c091c320-4d55-4578-82a2-4ad72b67f77d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:48.570983 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a461863e-8022-48bd-8d71-4de85fb4bb6e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.523889 Jun 14 19:42:48.572400 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 69/146] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:48 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:48.572699 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c091c320-4d55-4578-82a2-4ad72b67f77d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1365 microversion: 2.1 time: 0.395697 Jun 14 19:42:48.582409 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 78/147] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:48 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1365 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:48.583440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-23df7dab-a617-4010-ad01-4a77f37822a8 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:48.585427 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-23df7dab-a617-4010-ad01-4a77f37822a8 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:48.589279 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-827a5860-3904-4306-acc4-746cec80277e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:48.590227 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-827a5860-3904-4306-acc4-746cec80277e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:48.595698 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-23df7dab-a617-4010-ad01-4a77f37822a8 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:48.596345 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-23df7dab-a617-4010-ad01-4a77f37822a8 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:48.597842 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-827a5860-3904-4306-acc4-746cec80277e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:48.598004 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-23df7dab-a617-4010-ad01-4a77f37822a8 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:48.598549 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-23df7dab-a617-4010-ad01-4a77f37822a8 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:48.598875 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-827a5860-3904-4306-acc4-746cec80277e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:48.600192 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-827a5860-3904-4306-acc4-746cec80277e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:48.600778 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-827a5860-3904-4306-acc4-746cec80277e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:48.882477 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-23df7dab-a617-4010-ad01-4a77f37822a8 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:48.895885 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-827a5860-3904-4306-acc4-746cec80277e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:48.897741 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-23df7dab-a617-4010-ad01-4a77f37822a8 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1551 microversion: 2.1 time: 0.322365 Jun 14 19:42:48.898324 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 70/148] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:48 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1551 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:48.906408 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-8821e1db-0e7d-40cc-8f42-b752abe953c2 req-f656c2fd-a224-460e-b334-f9c94befffee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f063e7ec-ffab-48c6-b145-f51cd09dd5f4", "name": "network-vif-deleted", "tag": "f795a935-08ef-44b7-807d-5af2326db545"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:48.914350 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-827a5860-3904-4306-acc4-746cec80277e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1362 microversion: 2.1 time: 0.330554 Jun 14 19:42:48.914922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 79/149] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:48 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:48.916877 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-8821e1db-0e7d-40cc-8f42-b752abe953c2 req-f656c2fd-a224-460e-b334-f9c94befffee service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:48.917524 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-8821e1db-0e7d-40cc-8f42-b752abe953c2 req-f656c2fd-a224-460e-b334-f9c94befffee service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:48.936070 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-8821e1db-0e7d-40cc-8f42-b752abe953c2 req-f656c2fd-a224-460e-b334-f9c94befffee service nova] Creating event network-vif-deleted:f795a935-08ef-44b7-807d-5af2326db545 for instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 on hv-cinder-84580 Jun 14 19:42:48.942920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-8821e1db-0e7d-40cc-8f42-b752abe953c2 req-f656c2fd-a224-460e-b334-f9c94befffee service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042878 Jun 14 19:42:48.944422 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 71/150] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:42:49.165345 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-cd1fdcf1-1a6b-4b77-8227-487bd862ba74 req-cc4a6610-6150-4a3d-aa0e-567e9f1a8998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2d9ed3-941a-496c-b3c8-a9a5648cd846", "tag": "5445a8aa-6257-4a17-8a1b-eff254fa9a9d"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:49.174618 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-cd1fdcf1-1a6b-4b77-8227-487bd862ba74 req-cc4a6610-6150-4a3d-aa0e-567e9f1a8998 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:49.175593 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-cd1fdcf1-1a6b-4b77-8227-487bd862ba74 req-cc4a6610-6150-4a3d-aa0e-567e9f1a8998 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:49.193650 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-cd1fdcf1-1a6b-4b77-8227-487bd862ba74 req-cc4a6610-6150-4a3d-aa0e-567e9f1a8998 service nova] Creating event network-changed:5445a8aa-6257-4a17-8a1b-eff254fa9a9d for instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 on hv-cinder-84580 Jun 14 19:42:49.203192 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-cd1fdcf1-1a6b-4b77-8227-487bd862ba74 req-cc4a6610-6150-4a3d-aa0e-567e9f1a8998 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041355 Jun 14 19:42:49.204031 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 80/151] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:42:49.591667 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-33c595dd-8fc2-450c-b87d-7a926fc5373f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:49.592677 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-732f3690-36d8-4c42-80fd-1635a87dc6e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:49.593972 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-732f3690-36d8-4c42-80fd-1635a87dc6e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:49.594110 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-33c595dd-8fc2-450c-b87d-7a926fc5373f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:49.601789 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-732f3690-36d8-4c42-80fd-1635a87dc6e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:49.602684 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-732f3690-36d8-4c42-80fd-1635a87dc6e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:49.604061 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-732f3690-36d8-4c42-80fd-1635a87dc6e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:49.604983 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-732f3690-36d8-4c42-80fd-1635a87dc6e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:49.605365 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-33c595dd-8fc2-450c-b87d-7a926fc5373f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:49.606171 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-33c595dd-8fc2-450c-b87d-7a926fc5373f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:49.607338 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-33c595dd-8fc2-450c-b87d-7a926fc5373f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:49.616117 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-33c595dd-8fc2-450c-b87d-7a926fc5373f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:49.882767 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-732f3690-36d8-4c42-80fd-1635a87dc6e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:49.893906 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-33c595dd-8fc2-450c-b87d-7a926fc5373f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:49.902623 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-732f3690-36d8-4c42-80fd-1635a87dc6e5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.316173 Jun 14 19:42:49.903932 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-33c595dd-8fc2-450c-b87d-7a926fc5373f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1365 microversion: 2.1 time: 0.318360 Jun 14 19:42:49.905685 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 81/153] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:49 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1365 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:49.916377 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 72/153] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:49 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:49.923277 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d49a2e69-46f5-4e0c-848a-2e9a8adab7e7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:49.924166 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d49a2e69-46f5-4e0c-848a-2e9a8adab7e7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:49.931788 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d49a2e69-46f5-4e0c-848a-2e9a8adab7e7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:49.933435 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d49a2e69-46f5-4e0c-848a-2e9a8adab7e7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:49.934500 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d49a2e69-46f5-4e0c-848a-2e9a8adab7e7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:49.935171 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d49a2e69-46f5-4e0c-848a-2e9a8adab7e7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:49.949138 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-74e0e141-8289-465c-a61b-5e3719c9da3d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:49.951974 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-74e0e141-8289-465c-a61b-5e3719c9da3d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:49.961469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=100 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:49.961603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-74e0e141-8289-465c-a61b-5e3719c9da3d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:49.961972 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-74e0e141-8289-465c-a61b-5e3719c9da3d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:49.963974 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-74e0e141-8289-465c-a61b-5e3719c9da3d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:49.964535 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-74e0e141-8289-465c-a61b-5e3719c9da3d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:49.998961 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:50.016243 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d49a2e69-46f5-4e0c-848a-2e9a8adab7e7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:50.026092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d49a2e69-46f5-4e0c-848a-2e9a8adab7e7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1345 microversion: 2.1 time: 0.106847 Jun 14 19:42:50.029478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 82/154] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:49 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:50.153692 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-74e0e141-8289-465c-a61b-5e3719c9da3d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:50.163321 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-74e0e141-8289-465c-a61b-5e3719c9da3d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1549 microversion: 2.1 time: 0.232295 Jun 14 19:42:50.163906 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 73/155] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:49 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1549 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:50.183561 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0278af55-f2db-4444-9482-630802ffe2f3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:50.184144 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-0278af55-f2db-4444-9482-630802ffe2f3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:50.187529 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:50.191332 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0278af55-f2db-4444-9482-630802ffe2f3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:50.191793 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0278af55-f2db-4444-9482-630802ffe2f3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:50.192710 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0278af55-f2db-4444-9482-630802ffe2f3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:50.193340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0278af55-f2db-4444-9482-630802ffe2f3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:50.279384 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-0278af55-f2db-4444-9482-630802ffe2f3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101783 Jun 14 19:42:50.280176 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 83/156] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 14 19:42:50 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:42:50.921851 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a9250bbd-502d-41c9-a43e-240696577601 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:50.922770 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a9250bbd-502d-41c9-a43e-240696577601 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:50.926814 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9b4f7d1e-d26f-4e07-b773-ddba3ac1a9a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:50.929744 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9b4f7d1e-d26f-4e07-b773-ddba3ac1a9a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:50.934790 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a9250bbd-502d-41c9-a43e-240696577601 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:50.935378 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a9250bbd-502d-41c9-a43e-240696577601 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:50.936524 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a9250bbd-502d-41c9-a43e-240696577601 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:50.937736 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a9250bbd-502d-41c9-a43e-240696577601 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:50.942176 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9b4f7d1e-d26f-4e07-b773-ddba3ac1a9a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:50.942626 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9b4f7d1e-d26f-4e07-b773-ddba3ac1a9a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:50.943402 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9b4f7d1e-d26f-4e07-b773-ddba3ac1a9a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:50.943832 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9b4f7d1e-d26f-4e07-b773-ddba3ac1a9a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:51.122831 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a9250bbd-502d-41c9-a43e-240696577601 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:51.133745 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a9250bbd-502d-41c9-a43e-240696577601 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.216693 Jun 14 19:42:51.134940 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 74/157] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:50 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:51.141164 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-e357fc9c-b5d0-4e65-87ac-0a065c22e84f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:51.142420 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-e357fc9c-b5d0-4e65-87ac-0a065c22e84f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:51.150173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e357fc9c-b5d0-4e65-87ac-0a065c22e84f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:51.151070 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e357fc9c-b5d0-4e65-87ac-0a065c22e84f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:51.152039 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e357fc9c-b5d0-4e65-87ac-0a065c22e84f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:51.152548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e357fc9c-b5d0-4e65-87ac-0a065c22e84f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:51.228272 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e357fc9c-b5d0-4e65-87ac-0a065c22e84f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:51.236784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-e357fc9c-b5d0-4e65-87ac-0a065c22e84f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1345 microversion: 2.1 time: 0.100303 Jun 14 19:42:51.237354 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 75/158] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:51 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:51.362269 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9b4f7d1e-d26f-4e07-b773-ddba3ac1a9a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:51.371051 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9b4f7d1e-d26f-4e07-b773-ddba3ac1a9a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1554 microversion: 2.1 time: 0.451204 Jun 14 19:42:51.371722 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 84/159] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:50 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1554 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:51.388863 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b76d375a-511c-4f1e-ba38-2e46a87967cc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:51.389775 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b76d375a-511c-4f1e-ba38-2e46a87967cc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:51.395988 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b76d375a-511c-4f1e-ba38-2e46a87967cc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:51.396674 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b76d375a-511c-4f1e-ba38-2e46a87967cc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:51.397660 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b76d375a-511c-4f1e-ba38-2e46a87967cc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:51.398290 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b76d375a-511c-4f1e-ba38-2e46a87967cc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:51.486132 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b76d375a-511c-4f1e-ba38-2e46a87967cc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101691 Jun 14 19:42:51.492594 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 76/160] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 14 19:42:51 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:42:52.146006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-c75b017c-7dae-4547-afe2-36ee7917ca09 req-b9a8c1b4-3325-4654-9964-476d925c22d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "519d4f97-34a0-4df8-85fe-98149ad589a8", "tag": "b72f1385-2205-4302-9798-d34c009e5cc2"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:52.155708 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-df45fbb7-14d7-4ab4-9634-04f3636b750f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:52.155708 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-df45fbb7-14d7-4ab4-9634-04f3636b750f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:52.164854 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-df45fbb7-14d7-4ab4-9634-04f3636b750f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:52.167622 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-c75b017c-7dae-4547-afe2-36ee7917ca09 req-b9a8c1b4-3325-4654-9964-476d925c22d9 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:52.168113 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-c75b017c-7dae-4547-afe2-36ee7917ca09 req-b9a8c1b4-3325-4654-9964-476d925c22d9 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:52.168390 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-df45fbb7-14d7-4ab4-9634-04f3636b750f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:52.170733 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-df45fbb7-14d7-4ab4-9634-04f3636b750f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:52.173334 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-df45fbb7-14d7-4ab4-9634-04f3636b750f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:52.195145 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-c75b017c-7dae-4547-afe2-36ee7917ca09 req-b9a8c1b4-3325-4654-9964-476d925c22d9 service nova] Creating event network-changed:b72f1385-2205-4302-9798-d34c009e5cc2 for instance 519d4f97-34a0-4df8-85fe-98149ad589a8 on hv-cinder-84580 Jun 14 19:42:52.204121 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-c75b017c-7dae-4547-afe2-36ee7917ca09 req-b9a8c1b4-3325-4654-9964-476d925c22d9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065330 Jun 14 19:42:52.205139 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 85/161] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:42:52.255004 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-cdd39ee1-ac98-4b93-ab13-e8d2e42dadef tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:52.256074 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-cdd39ee1-ac98-4b93-ab13-e8d2e42dadef tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:52.265892 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cdd39ee1-ac98-4b93-ab13-e8d2e42dadef tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:52.272121 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cdd39ee1-ac98-4b93-ab13-e8d2e42dadef tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:52.273144 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cdd39ee1-ac98-4b93-ab13-e8d2e42dadef tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:52.275764 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cdd39ee1-ac98-4b93-ab13-e8d2e42dadef tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:52.375464 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-cdd39ee1-ac98-4b93-ab13-e8d2e42dadef tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:52.384731 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-cdd39ee1-ac98-4b93-ab13-e8d2e42dadef tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1345 microversion: 2.1 time: 0.133518 Jun 14 19:42:52.389568 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 86/162] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:52 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:52.419300 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-df45fbb7-14d7-4ab4-9634-04f3636b750f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:52.428039 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-df45fbb7-14d7-4ab4-9634-04f3636b750f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.281589 Jun 14 19:42:52.439150 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 77/163] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:52 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:53.407156 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-652f2c84-3b16-462d-b54f-0d7b068fdd00 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:53.408469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-652f2c84-3b16-462d-b54f-0d7b068fdd00 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:53.416860 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-652f2c84-3b16-462d-b54f-0d7b068fdd00 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:53.417313 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-652f2c84-3b16-462d-b54f-0d7b068fdd00 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:53.418321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-652f2c84-3b16-462d-b54f-0d7b068fdd00 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:53.418753 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-652f2c84-3b16-462d-b54f-0d7b068fdd00 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:53.445922 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-e41baee6-d5e5-4714-8cbd-7f375de8555d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:53.446740 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-e41baee6-d5e5-4714-8cbd-7f375de8555d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:53.460347 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e41baee6-d5e5-4714-8cbd-7f375de8555d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:53.460947 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e41baee6-d5e5-4714-8cbd-7f375de8555d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:53.461764 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e41baee6-d5e5-4714-8cbd-7f375de8555d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:53.471104 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e41baee6-d5e5-4714-8cbd-7f375de8555d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:53.547393 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-652f2c84-3b16-462d-b54f-0d7b068fdd00 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:53.558835 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-652f2c84-3b16-462d-b54f-0d7b068fdd00 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1345 microversion: 2.1 time: 0.156711 Jun 14 19:42:53.561013 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 87/164] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:53 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1345 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:53.679680 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e41baee6-d5e5-4714-8cbd-7f375de8555d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:53.688642 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-e41baee6-d5e5-4714-8cbd-7f375de8555d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.246864 Jun 14 19:42:53.689712 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 78/165] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:53 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:54.220606 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-a5b30116-c2f6-45c7-9090-821b41ebbd95 req-b67d5bd1-5ff5-4766-9fcf-8c5925603e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1434a82-cdbc-474b-95c4-44331ae4a084", "tag": "9ccf27ae-101e-466d-957e-384dd10e0dbb"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:54.229218 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-a5b30116-c2f6-45c7-9090-821b41ebbd95 req-b67d5bd1-5ff5-4766-9fcf-8c5925603e72 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:54.229893 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-a5b30116-c2f6-45c7-9090-821b41ebbd95 req-b67d5bd1-5ff5-4766-9fcf-8c5925603e72 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:54.241957 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-a5b30116-c2f6-45c7-9090-821b41ebbd95 req-b67d5bd1-5ff5-4766-9fcf-8c5925603e72 service nova] Creating event network-changed:9ccf27ae-101e-466d-957e-384dd10e0dbb for instance f1434a82-cdbc-474b-95c4-44331ae4a084 on hv-cinder-84580 Jun 14 19:42:54.249584 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-a5b30116-c2f6-45c7-9090-821b41ebbd95 req-b67d5bd1-5ff5-4766-9fcf-8c5925603e72 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033146 Jun 14 19:42:54.250177 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 88/166] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:42:54.577482 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-27dbe218-25ee-4e30-bc92-c35fe7f4c18a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:54.578095 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-27dbe218-25ee-4e30-bc92-c35fe7f4c18a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:54.584845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-27dbe218-25ee-4e30-bc92-c35fe7f4c18a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:54.585301 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-27dbe218-25ee-4e30-bc92-c35fe7f4c18a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:54.586165 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-27dbe218-25ee-4e30-bc92-c35fe7f4c18a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:54.586663 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-27dbe218-25ee-4e30-bc92-c35fe7f4c18a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:54.665802 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-27dbe218-25ee-4e30-bc92-c35fe7f4c18a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:54.674364 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-27dbe218-25ee-4e30-bc92-c35fe7f4c18a tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1345 microversion: 2.1 time: 0.100679 Jun 14 19:42:54.674916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 79/167] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:54 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:54.707029 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4a73e3e3-62a1-4c91-92a5-c73a7dc80c39 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:54.707864 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4a73e3e3-62a1-4c91-92a5-c73a7dc80c39 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:54.714584 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4a73e3e3-62a1-4c91-92a5-c73a7dc80c39 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:54.715125 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4a73e3e3-62a1-4c91-92a5-c73a7dc80c39 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:54.715875 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4a73e3e3-62a1-4c91-92a5-c73a7dc80c39 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:54.716301 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4a73e3e3-62a1-4c91-92a5-c73a7dc80c39 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:54.868002 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4a73e3e3-62a1-4c91-92a5-c73a7dc80c39 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:54.876324 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4a73e3e3-62a1-4c91-92a5-c73a7dc80c39 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.173545 Jun 14 19:42:54.877071 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 89/168] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:54 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:55.692146 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-03981930-71a1-469b-a418-da66961e6d77 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:55.692833 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-03981930-71a1-469b-a418-da66961e6d77 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:55.699838 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-03981930-71a1-469b-a418-da66961e6d77 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:55.700468 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-03981930-71a1-469b-a418-da66961e6d77 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:55.701227 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-03981930-71a1-469b-a418-da66961e6d77 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:55.701702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-03981930-71a1-469b-a418-da66961e6d77 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:55.769435 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-03981930-71a1-469b-a418-da66961e6d77 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:55.778037 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-03981930-71a1-469b-a418-da66961e6d77 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1345 microversion: 2.1 time: 0.089851 Jun 14 19:42:55.778612 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 80/169] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:55 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:55.893012 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1a14ad21-c474-4930-9fce-a95e2c74abc6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:55.893646 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1a14ad21-c474-4930-9fce-a95e2c74abc6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:55.899598 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1a14ad21-c474-4930-9fce-a95e2c74abc6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:55.900032 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1a14ad21-c474-4930-9fce-a95e2c74abc6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:55.900779 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1a14ad21-c474-4930-9fce-a95e2c74abc6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:55.901205 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1a14ad21-c474-4930-9fce-a95e2c74abc6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:56.031423 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1a14ad21-c474-4930-9fce-a95e2c74abc6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:56.039488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1a14ad21-c474-4930-9fce-a95e2c74abc6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1321 microversion: 2.1 time: 0.150192 Jun 14 19:42:56.040061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 90/170] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:55 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:56.796856 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-58473656-d2fe-4601-b719-2e153b7fb0a1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:56.798583 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-58473656-d2fe-4601-b719-2e153b7fb0a1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:56.812471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-58473656-d2fe-4601-b719-2e153b7fb0a1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:56.814204 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-58473656-d2fe-4601-b719-2e153b7fb0a1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:56.815137 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-58473656-d2fe-4601-b719-2e153b7fb0a1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:56.827466 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-58473656-d2fe-4601-b719-2e153b7fb0a1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:56.913695 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-58473656-d2fe-4601-b719-2e153b7fb0a1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:56.922642 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-58473656-d2fe-4601-b719-2e153b7fb0a1 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1345 microversion: 2.1 time: 0.129890 Jun 14 19:42:56.923211 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 81/171] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:56 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:57.056620 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c638804f-9cc3-4158-83ee-97134b30eead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:57.057312 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c638804f-9cc3-4158-83ee-97134b30eead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:57.063406 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c638804f-9cc3-4158-83ee-97134b30eead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:57.063853 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c638804f-9cc3-4158-83ee-97134b30eead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:57.064632 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c638804f-9cc3-4158-83ee-97134b30eead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:57.065069 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c638804f-9cc3-4158-83ee-97134b30eead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:57.197028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c638804f-9cc3-4158-83ee-97134b30eead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:57.204179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c638804f-9cc3-4158-83ee-97134b30eead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1514 microversion: 2.1 time: 0.152104 Jun 14 19:42:57.204740 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 91/172] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:57 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:57.222236 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a9b661c6-be10-422e-8343-c57a38417575 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:42:57.223244 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a9b661c6-be10-422e-8343-c57a38417575 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:57.230417 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a9b661c6-be10-422e-8343-c57a38417575 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:57.230860 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a9b661c6-be10-422e-8343-c57a38417575 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:57.231614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a9b661c6-be10-422e-8343-c57a38417575 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:57.232042 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a9b661c6-be10-422e-8343-c57a38417575 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:57.255627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.objects.instance [None req-a9b661c6-be10-422e-8343-c57a38417575 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lazy-loading 'flavor' on Instance uuid bc5647b9-307a-4287-be2e-34a8aa3703ba {{(pid=124069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:42:57.414488 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a9b661c6-be10-422e-8343-c57a38417575 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "POST /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba/action" status: 200 len: 32 microversion: 2.1 time: 0.196038 Jun 14 19:42:57.415333 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 82/173] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 14 19:42:57 2022] POST /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 19:42:57.425687 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-28642c9b-af4a-4d99-95d3-a5f07e953d6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:57.426328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-28642c9b-af4a-4d99-95d3-a5f07e953d6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:57.433956 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-28642c9b-af4a-4d99-95d3-a5f07e953d6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:57.434433 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-28642c9b-af4a-4d99-95d3-a5f07e953d6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:57.435444 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-28642c9b-af4a-4d99-95d3-a5f07e953d6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:57.435980 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-28642c9b-af4a-4d99-95d3-a5f07e953d6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:57.941283 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-227c7cf7-0722-4b58-abd0-f290234bd580 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:57.943404 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-227c7cf7-0722-4b58-abd0-f290234bd580 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:57.959421 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-227c7cf7-0722-4b58-abd0-f290234bd580 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:57.960040 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-227c7cf7-0722-4b58-abd0-f290234bd580 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:57.961112 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-227c7cf7-0722-4b58-abd0-f290234bd580 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:57.961991 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-227c7cf7-0722-4b58-abd0-f290234bd580 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:58.038936 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-227c7cf7-0722-4b58-abd0-f290234bd580 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:58.039266 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-227c7cf7-0722-4b58-abd0-f290234bd580 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:58.043493 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.objects.instance [None req-227c7cf7-0722-4b58-abd0-f290234bd580 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lazy-loading 'fault' on Instance uuid f063e7ec-ffab-48c6-b145-f51cd09dd5f4 {{(pid=124069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:42:58.050523 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-28642c9b-af4a-4d99-95d3-a5f07e953d6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:58.062879 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-28642c9b-af4a-4d99-95d3-a5f07e953d6c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.641469 Jun 14 19:42:58.064754 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 92/174] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:57 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:58.167942 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-227c7cf7-0722-4b58-abd0-f290234bd580 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54575b28e7ec4f04a9884a35d5feec2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58bb3d02c5c043d39785a31a7ee33b35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:58.175452 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-227c7cf7-0722-4b58-abd0-f290234bd580 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 200 len: 1304 microversion: 2.1 time: 0.239084 Jun 14 19:42:58.176033 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 83/175] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:57 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 1304 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:42:59.084918 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f632fbc6-2c7f-4de1-969f-f51b0495eec9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:59.089955 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f632fbc6-2c7f-4de1-969f-f51b0495eec9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:59.105283 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f632fbc6-2c7f-4de1-969f-f51b0495eec9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:59.107414 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f632fbc6-2c7f-4de1-969f-f51b0495eec9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:59.108450 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f632fbc6-2c7f-4de1-969f-f51b0495eec9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:59.115870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f632fbc6-2c7f-4de1-969f-f51b0495eec9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:59.192358 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-bedbe18f-16e9-476a-82e0-4e519f54e99f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:59.192977 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-bedbe18f-16e9-476a-82e0-4e519f54e99f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:59.200275 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bedbe18f-16e9-476a-82e0-4e519f54e99f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:59.200724 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bedbe18f-16e9-476a-82e0-4e519f54e99f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:59.201523 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bedbe18f-16e9-476a-82e0-4e519f54e99f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:59.201959 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bedbe18f-16e9-476a-82e0-4e519f54e99f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:59.216594 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-bedbe18f-16e9-476a-82e0-4e519f54e99f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] HTTP exception thrown: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-bedbe18f-16e9-476a-82e0-4e519f54e99f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Request method failure captured: Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 HTTP/1.1 Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSB_uCcPsoOzhn9kBLrp-jrCxeuQUVek-93satKTHaV_ebLRvxswNGUvJ3GEnT88CoGdCW7bCNWkWaQ-u_xsp2r0xlciQQ59M_zu5y5M5nhp-h3dHRDwq4I4a8a-cKWsdBd7IU2s5lIw4G8V_Aj7TANnsVW-KzlyELxB_C4O6jMfFk Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: 58bb3d02c5c043d39785a31a7ee33b35 Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-DeleteServersTestJSON-662915148 Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:42:59.232331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:42:59.233561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/58bb3d02c5c043d39785a31a7ee33b35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_58bb3d02c5c043d39785a31a7ee33b35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/58bb3d02c5c043d39785a31a7ee33b35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/58bb3d02c5c043d39785a31a7ee33b35"}]}] Jun 14 19:42:59.233561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-DeleteServersTestJSON-662915148 Jun 14 19:42:59.233561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: 58bb3d02c5c043d39785a31a7ee33b35 Jun 14 19:42:59.233561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-DeleteServersTestJSON-662915148 Jun 14 19:42:59.233561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-DeleteServersTestJSON-662915148-project Jun 14 19:42:59.233561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:42:59.233561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:42:59.233561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 54575b28e7ec4f04a9884a35d5feec2e Jun 14 19:42:59.233561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-DeleteServersTestJSON-662915148-project Jun 14 19:42:59.233561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:42:59.233561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:42:59.233561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': 'f063e7ec-ffab-48c6-b145-f51cd09dd5f4'} Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:42:59.234265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:42:59.238734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:42:59.239678 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-bedbe18f-16e9-476a-82e0-4e519f54e99f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Returning 404 to user: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:42:59.239678 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-bedbe18f-16e9-476a-82e0-4e519f54e99f tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 404 len: 111 microversion: 2.1 time: 0.045572 Jun 14 19:42:59.239678 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 84/176] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:59 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 19:42:59.375918 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1b68ec77-f0aa-4160-9779-16e9d00095ab tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:42:59.377116 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-1b68ec77-f0aa-4160-9779-16e9d00095ab tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:42:59.386264 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1b68ec77-f0aa-4160-9779-16e9d00095ab tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:59.386917 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1b68ec77-f0aa-4160-9779-16e9d00095ab tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:59.388013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1b68ec77-f0aa-4160-9779-16e9d00095ab tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:42:59.388603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1b68ec77-f0aa-4160-9779-16e9d00095ab tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:42:59.392763 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-f632fbc6-2c7f-4de1-969f-f51b0495eec9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:42:59.406076 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f632fbc6-2c7f-4de1-969f-f51b0495eec9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.328458 Jun 14 19:42:59.418106 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 93/177] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:42:59 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:42:59.428767 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-1b68ec77-f0aa-4160-9779-16e9d00095ab tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] HTTP exception thrown: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1b68ec77-f0aa-4160-9779-16e9d00095ab tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Request method failure captured: Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4/os-volume_attachments HTTP/1.1 Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSB_uCcPsoOzhn9kBLrp-jrCxeuQUVek-93satKTHaV_ebLRvxswNGUvJ3GEnT88CoGdCW7bCNWkWaQ-u_xsp2r0xlciQQ59M_zu5y5M5nhp-h3dHRDwq4I4a8a-cKWsdBd7IU2s5lIw4G8V_Aj7TANnsVW-KzlyELxB_C4O6jMfFk Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: 58bb3d02c5c043d39785a31a7ee33b35 Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-DeleteServersTestJSON-662915148 Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:42:59.432405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:42:59.433735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/58bb3d02c5c043d39785a31a7ee33b35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_58bb3d02c5c043d39785a31a7ee33b35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/58bb3d02c5c043d39785a31a7ee33b35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/58bb3d02c5c043d39785a31a7ee33b35"}]}] Jun 14 19:42:59.433735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-DeleteServersTestJSON-662915148 Jun 14 19:42:59.433735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: 58bb3d02c5c043d39785a31a7ee33b35 Jun 14 19:42:59.433735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-DeleteServersTestJSON-662915148 Jun 14 19:42:59.433735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-DeleteServersTestJSON-662915148-project Jun 14 19:42:59.433735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:42:59.433735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:42:59.433735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 54575b28e7ec4f04a9884a35d5feec2e Jun 14 19:42:59.433735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-DeleteServersTestJSON-662915148-project Jun 14 19:42:59.433735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:42:59.433735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:42:59.433735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'server_id': 'f063e7ec-ffab-48c6-b145-f51cd09dd5f4'} Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:42:59.434505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:42:59.435627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:42:59.438908 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1b68ec77-f0aa-4160-9779-16e9d00095ab tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Returning 404 to user: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:42:59.440034 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-1b68ec77-f0aa-4160-9779-16e9d00095ab tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.068597 Jun 14 19:42:59.441437 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 85/178] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:42:59 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4/os-volume_attachments => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 19:43:00.433064 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-ce1592d3-f930-4f20-88e8-97cc7de4382f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:00.433790 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-ce1592d3-f930-4f20-88e8-97cc7de4382f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:00.440467 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ce1592d3-f930-4f20-88e8-97cc7de4382f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:00.441206 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ce1592d3-f930-4f20-88e8-97cc7de4382f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:00.442364 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ce1592d3-f930-4f20-88e8-97cc7de4382f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:00.442961 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ce1592d3-f930-4f20-88e8-97cc7de4382f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:00.610207 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ce1592d3-f930-4f20-88e8-97cc7de4382f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:00.620689 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-ce1592d3-f930-4f20-88e8-97cc7de4382f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.192515 Jun 14 19:43:00.621654 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 94/179] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:00 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:00.700952 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6bf69a42-cfa1-401a-b309-92d5a5746172 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:00.701701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-6bf69a42-cfa1-401a-b309-92d5a5746172 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:00.708414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6bf69a42-cfa1-401a-b309-92d5a5746172 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:00.708996 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6bf69a42-cfa1-401a-b309-92d5a5746172 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:00.709912 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6bf69a42-cfa1-401a-b309-92d5a5746172 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:00.710433 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6bf69a42-cfa1-401a-b309-92d5a5746172 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:00.724628 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-6bf69a42-cfa1-401a-b309-92d5a5746172 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] HTTP exception thrown: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6bf69a42-cfa1-401a-b309-92d5a5746172 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Request method failure captured: Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: DELETE /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 HTTP/1.1 Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSB_uCcPsoOzhn9kBLrp-jrCxeuQUVek-93satKTHaV_ebLRvxswNGUvJ3GEnT88CoGdCW7bCNWkWaQ-u_xsp2r0xlciQQ59M_zu5y5M5nhp-h3dHRDwq4I4a8a-cKWsdBd7IU2s5lIw4G8V_Aj7TANnsVW-KzlyELxB_C4O6jMfFk Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: 58bb3d02c5c043d39785a31a7ee33b35 Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-DeleteServersTestJSON-662915148 Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:43:00.728075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:43:00.729777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/58bb3d02c5c043d39785a31a7ee33b35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_58bb3d02c5c043d39785a31a7ee33b35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/58bb3d02c5c043d39785a31a7ee33b35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/58bb3d02c5c043d39785a31a7ee33b35"}]}] Jun 14 19:43:00.729777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-DeleteServersTestJSON-662915148 Jun 14 19:43:00.729777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: 58bb3d02c5c043d39785a31a7ee33b35 Jun 14 19:43:00.729777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-DeleteServersTestJSON-662915148 Jun 14 19:43:00.729777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-DeleteServersTestJSON-662915148-project Jun 14 19:43:00.729777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:43:00.729777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:43:00.729777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 54575b28e7ec4f04a9884a35d5feec2e Jun 14 19:43:00.729777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-DeleteServersTestJSON-662915148-project Jun 14 19:43:00.729777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:43:00.729777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:43:00.729777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': 'f063e7ec-ffab-48c6-b145-f51cd09dd5f4'} Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:43:00.730608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:43:00.731892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:43:00.733601 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6bf69a42-cfa1-401a-b309-92d5a5746172 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Returning 404 to user: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:43:00.733601 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6bf69a42-cfa1-401a-b309-92d5a5746172 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 404 len: 111 microversion: 2.1 time: 0.034208 Jun 14 19:43:00.733601 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 86/180] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:43:00 2022] DELETE /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:43:00.741707 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d0f27ea7-6ced-48f3-b77a-5a663b2fbff7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:00.742368 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d0f27ea7-6ced-48f3-b77a-5a663b2fbff7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] [instance: f063e7ec-ffab-48c6-b145-f51cd09dd5f4] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:00.749894 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0f27ea7-6ced-48f3-b77a-5a663b2fbff7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:00.750338 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0f27ea7-6ced-48f3-b77a-5a663b2fbff7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:00.751101 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0f27ea7-6ced-48f3-b77a-5a663b2fbff7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:00.751525 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0f27ea7-6ced-48f3-b77a-5a663b2fbff7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:00.768715 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-d0f27ea7-6ced-48f3-b77a-5a663b2fbff7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] HTTP exception thrown: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d0f27ea7-6ced-48f3-b77a-5a663b2fbff7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Request method failure captured: Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 HTTP/1.1 Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOSB_uCcPsoOzhn9kBLrp-jrCxeuQUVek-93satKTHaV_ebLRvxswNGUvJ3GEnT88CoGdCW7bCNWkWaQ-u_xsp2r0xlciQQ59M_zu5y5M5nhp-h3dHRDwq4I4a8a-cKWsdBd7IU2s5lIw4G8V_Aj7TANnsVW-KzlyELxB_C4O6jMfFk Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: 58bb3d02c5c043d39785a31a7ee33b35 Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-DeleteServersTestJSON-662915148 Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:43:00.773904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:43:00.775516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/58bb3d02c5c043d39785a31a7ee33b35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_58bb3d02c5c043d39785a31a7ee33b35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/58bb3d02c5c043d39785a31a7ee33b35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/58bb3d02c5c043d39785a31a7ee33b35"}]}] Jun 14 19:43:00.775516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-DeleteServersTestJSON-662915148 Jun 14 19:43:00.775516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: 58bb3d02c5c043d39785a31a7ee33b35 Jun 14 19:43:00.775516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-DeleteServersTestJSON-662915148 Jun 14 19:43:00.775516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-DeleteServersTestJSON-662915148-project Jun 14 19:43:00.775516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:43:00.775516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:43:00.775516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 54575b28e7ec4f04a9884a35d5feec2e Jun 14 19:43:00.775516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-DeleteServersTestJSON-662915148-project Jun 14 19:43:00.775516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:43:00.775516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:43:00.775516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': 'f063e7ec-ffab-48c6-b145-f51cd09dd5f4'} Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:43:00.776147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. Jun 14 19:43:00.778449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:43:00.780340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d0f27ea7-6ced-48f3-b77a-5a663b2fbff7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] Returning 404 to user: Instance f063e7ec-ffab-48c6-b145-f51cd09dd5f4 could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:43:00.780340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d0f27ea7-6ced-48f3-b77a-5a663b2fbff7 tempest-DeleteServersTestJSON-662915148 tempest-DeleteServersTestJSON-662915148-project] 10.222.0.44 "GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4" status: 404 len: 111 microversion: 2.1 time: 0.038361 Jun 14 19:43:00.780340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 95/181] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:00 2022] GET /compute/v2.1/servers/f063e7ec-ffab-48c6-b145-f51cd09dd5f4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 19:43:01.640371 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4c138782-230a-4e00-bd70-df5817792c90 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:01.641093 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4c138782-230a-4e00-bd70-df5817792c90 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:01.650428 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4c138782-230a-4e00-bd70-df5817792c90 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:01.650897 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4c138782-230a-4e00-bd70-df5817792c90 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:01.651696 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4c138782-230a-4e00-bd70-df5817792c90 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:01.652591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4c138782-230a-4e00-bd70-df5817792c90 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:01.939741 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4c138782-230a-4e00-bd70-df5817792c90 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:01.948371 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4c138782-230a-4e00-bd70-df5817792c90 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.313645 Jun 14 19:43:01.951935 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 87/182] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:01 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:02.969527 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b32e97de-5528-4c1d-9f93-6764a031d829 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:02.970759 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b32e97de-5528-4c1d-9f93-6764a031d829 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:02.980501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b32e97de-5528-4c1d-9f93-6764a031d829 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:02.980957 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b32e97de-5528-4c1d-9f93-6764a031d829 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:02.981804 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b32e97de-5528-4c1d-9f93-6764a031d829 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:02.982295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b32e97de-5528-4c1d-9f93-6764a031d829 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:03.173807 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b32e97de-5528-4c1d-9f93-6764a031d829 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:03.177130 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b32e97de-5528-4c1d-9f93-6764a031d829 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.215571 Jun 14 19:43:03.177739 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 96/183] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:02 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:04.195040 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-96dc82cb-15bf-414f-a7a4-4afb29a0fefd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:04.195653 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-96dc82cb-15bf-414f-a7a4-4afb29a0fefd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:04.203249 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96dc82cb-15bf-414f-a7a4-4afb29a0fefd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:04.203703 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96dc82cb-15bf-414f-a7a4-4afb29a0fefd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:04.204472 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96dc82cb-15bf-414f-a7a4-4afb29a0fefd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:04.204907 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96dc82cb-15bf-414f-a7a4-4afb29a0fefd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:04.347148 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-96dc82cb-15bf-414f-a7a4-4afb29a0fefd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:04.354632 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-96dc82cb-15bf-414f-a7a4-4afb29a0fefd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.163434 Jun 14 19:43:04.355207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 88/184] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:04 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:05.377709 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c83fc01c-1a59-40d4-be62-4aea8202569a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:05.378573 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c83fc01c-1a59-40d4-be62-4aea8202569a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:05.389092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c83fc01c-1a59-40d4-be62-4aea8202569a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:05.389900 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c83fc01c-1a59-40d4-be62-4aea8202569a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:05.390907 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c83fc01c-1a59-40d4-be62-4aea8202569a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:05.391710 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c83fc01c-1a59-40d4-be62-4aea8202569a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:05.573320 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c83fc01c-1a59-40d4-be62-4aea8202569a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:05.587416 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c83fc01c-1a59-40d4-be62-4aea8202569a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.216969 Jun 14 19:43:05.588668 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 97/185] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:05 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:06.605053 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-bb09fae0-bf3d-407f-b85e-3799e0c03e36 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:06.605737 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-bb09fae0-bf3d-407f-b85e-3799e0c03e36 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:06.612063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bb09fae0-bf3d-407f-b85e-3799e0c03e36 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:06.612514 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bb09fae0-bf3d-407f-b85e-3799e0c03e36 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:06.613281 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bb09fae0-bf3d-407f-b85e-3799e0c03e36 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:06.613740 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bb09fae0-bf3d-407f-b85e-3799e0c03e36 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:06.762941 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-bb09fae0-bf3d-407f-b85e-3799e0c03e36 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:06.770928 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-bb09fae0-bf3d-407f-b85e-3799e0c03e36 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.169784 Jun 14 19:43:06.771479 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 89/186] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:06 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:07.016386 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1540918221", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "networks": [{"uuid": "a5591a0a-a877-44a4-9389-1776d51447b2"}]}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:43:07.067907 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.network.neutron [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] validate_networks() for [('a5591a0a-a877-44a4-9389-1776d51447b2', None, None, None, None, None)] {{(pid=124068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:43:07.425205 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Flavor limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:43:07.425650 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Image limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:43:07.426124 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Flavor pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:43:07.426528 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Image pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:43:07.426932 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:43:07.436812 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:07.437256 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:07.438081 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:07.438511 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:07.455702 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Getting quotas for project cbf704ce7bfd49f5b83ca2e7e0120c91. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:43:07.459593 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Getting quotas for user de843beff4dd401fb34b34ab83f6f7f3 and project cbf704ce7bfd49f5b83ca2e7e0120c91. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:43:07.470654 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Going to run 1 instances... {{(pid=124068) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:43:07.472866 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:43:07.518051 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-bd15e1b0-9023-437f-a0f6-744e360738dd tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505367 Jun 14 19:43:07.523778 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 98/187] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:43:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:43:07.529622 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8e98d276-f323-4c8a-887a-d8b1081d82b7 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:07.530231 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8e98d276-f323-4c8a-887a-d8b1081d82b7 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:07.599467 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8e98d276-f323-4c8a-887a-d8b1081d82b7 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:07.606897 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8e98d276-f323-4c8a-887a-d8b1081d82b7 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6" status: 200 len: 1214 microversion: 2.1 time: 0.081013 Jun 14 19:43:07.610417 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 90/188] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:07 2022] GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:43:07.789686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c7ce6b79-66df-455f-8f7b-811a727069bd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:07.791146 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c7ce6b79-66df-455f-8f7b-811a727069bd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:07.800520 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c7ce6b79-66df-455f-8f7b-811a727069bd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:07.801209 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c7ce6b79-66df-455f-8f7b-811a727069bd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:07.802516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c7ce6b79-66df-455f-8f7b-811a727069bd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:07.803157 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c7ce6b79-66df-455f-8f7b-811a727069bd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:07.978326 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c7ce6b79-66df-455f-8f7b-811a727069bd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:07.987269 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c7ce6b79-66df-455f-8f7b-811a727069bd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.202105 Jun 14 19:43:07.988224 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 99/189] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:07 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:08.624677 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2d8dfde5-784a-4989-b140-f6c2bd6b51a3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:08.625470 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2d8dfde5-784a-4989-b140-f6c2bd6b51a3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:08.632071 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2d8dfde5-784a-4989-b140-f6c2bd6b51a3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:08.632512 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2d8dfde5-784a-4989-b140-f6c2bd6b51a3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:08.633259 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2d8dfde5-784a-4989-b140-f6c2bd6b51a3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:08.634021 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2d8dfde5-784a-4989-b140-f6c2bd6b51a3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:08.636930 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:08.860447 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2d8dfde5-784a-4989-b140-f6c2bd6b51a3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:08.869022 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2d8dfde5-784a-4989-b140-f6c2bd6b51a3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6" status: 200 len: 1284 microversion: 2.1 time: 0.248375 Jun 14 19:43:08.869647 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 91/190] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:08 2022] GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 => generated 1284 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:09.006343 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-637d38fa-fe55-43a8-993f-439ced89da20 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:09.007075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-637d38fa-fe55-43a8-993f-439ced89da20 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:09.022153 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-637d38fa-fe55-43a8-993f-439ced89da20 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:09.022608 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-637d38fa-fe55-43a8-993f-439ced89da20 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:09.023598 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-637d38fa-fe55-43a8-993f-439ced89da20 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:09.024069 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-637d38fa-fe55-43a8-993f-439ced89da20 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:09.218261 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-637d38fa-fe55-43a8-993f-439ced89da20 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:09.230010 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-637d38fa-fe55-43a8-993f-439ced89da20 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.227628 Jun 14 19:43:09.232365 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 100/191] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:09 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:09.889160 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-5062dd36-bf4c-4472-865e-f9df9e99f9b9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:09.890819 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-5062dd36-bf4c-4472-865e-f9df9e99f9b9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:09.901060 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5062dd36-bf4c-4472-865e-f9df9e99f9b9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:09.901830 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5062dd36-bf4c-4472-865e-f9df9e99f9b9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:09.902834 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5062dd36-bf4c-4472-865e-f9df9e99f9b9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:09.903473 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5062dd36-bf4c-4472-865e-f9df9e99f9b9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:10.163822 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-5062dd36-bf4c-4472-865e-f9df9e99f9b9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:10.171929 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-5062dd36-bf4c-4472-865e-f9df9e99f9b9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.288896 Jun 14 19:43:10.172752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 92/192] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:09 2022] GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:10.248896 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-42ff91c2-7d9c-4e08-8377-9306da80e38e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:10.250244 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-42ff91c2-7d9c-4e08-8377-9306da80e38e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:10.257019 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-42ff91c2-7d9c-4e08-8377-9306da80e38e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:10.257671 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-42ff91c2-7d9c-4e08-8377-9306da80e38e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:10.259155 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-42ff91c2-7d9c-4e08-8377-9306da80e38e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:10.259850 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-42ff91c2-7d9c-4e08-8377-9306da80e38e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:10.499315 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-b851ab3f-15e9-429c-a8f1-55e75f8612e0 req-13bdc7e9-6d48-4bcd-b749-390d2a1335db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0963b81-0245-424c-a0df-f8605d5e3ae6", "tag": "863c8a4a-1808-4ca8-9b31-e9614048af5e"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:43:10.512842 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-b851ab3f-15e9-429c-a8f1-55e75f8612e0 req-13bdc7e9-6d48-4bcd-b749-390d2a1335db service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:10.517460 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-b851ab3f-15e9-429c-a8f1-55e75f8612e0 req-13bdc7e9-6d48-4bcd-b749-390d2a1335db service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:10.529559 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-b851ab3f-15e9-429c-a8f1-55e75f8612e0 req-13bdc7e9-6d48-4bcd-b749-390d2a1335db service nova] Creating event network-changed:863c8a4a-1808-4ca8-9b31-e9614048af5e for instance f0963b81-0245-424c-a0df-f8605d5e3ae6 on hv-cinder-84580 Jun 14 19:43:10.535034 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-b851ab3f-15e9-429c-a8f1-55e75f8612e0 req-13bdc7e9-6d48-4bcd-b749-390d2a1335db service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040980 Jun 14 19:43:10.536397 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 93/193] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:43:10.771507 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-42ff91c2-7d9c-4e08-8377-9306da80e38e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:10.775456 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=100 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:10.784129 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-42ff91c2-7d9c-4e08-8377-9306da80e38e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.538897 Jun 14 19:43:10.795029 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 101/194] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:10 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:11.190945 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9590f90d-cf35-4166-8bcd-3f925633fa0b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:11.191820 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9590f90d-cf35-4166-8bcd-3f925633fa0b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:11.200195 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9590f90d-cf35-4166-8bcd-3f925633fa0b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:11.200873 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9590f90d-cf35-4166-8bcd-3f925633fa0b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:11.202099 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9590f90d-cf35-4166-8bcd-3f925633fa0b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:11.202722 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9590f90d-cf35-4166-8bcd-3f925633fa0b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:11.347865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9590f90d-cf35-4166-8bcd-3f925633fa0b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:11.355549 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9590f90d-cf35-4166-8bcd-3f925633fa0b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.168989 Jun 14 19:43:11.356319 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 94/195] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:11 2022] GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:11.802551 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9c02770f-538b-4f77-9afb-1402ef9a6a5b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:11.803853 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9c02770f-538b-4f77-9afb-1402ef9a6a5b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:11.817816 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c02770f-538b-4f77-9afb-1402ef9a6a5b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:11.819211 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c02770f-538b-4f77-9afb-1402ef9a6a5b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:11.821176 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c02770f-538b-4f77-9afb-1402ef9a6a5b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:11.821949 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c02770f-538b-4f77-9afb-1402ef9a6a5b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:11.987962 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9c02770f-538b-4f77-9afb-1402ef9a6a5b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:11.997172 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9c02770f-538b-4f77-9afb-1402ef9a6a5b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.199756 Jun 14 19:43:11.998104 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 102/196] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:11 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:12.373119 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c0f9b3f9-3423-46dc-a58d-69ed0f872b66 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:12.373776 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c0f9b3f9-3423-46dc-a58d-69ed0f872b66 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:12.382649 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0f9b3f9-3423-46dc-a58d-69ed0f872b66 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:12.383434 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0f9b3f9-3423-46dc-a58d-69ed0f872b66 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:12.384401 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0f9b3f9-3423-46dc-a58d-69ed0f872b66 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:12.384969 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0f9b3f9-3423-46dc-a58d-69ed0f872b66 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:12.614284 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c0f9b3f9-3423-46dc-a58d-69ed0f872b66 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:12.628445 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c0f9b3f9-3423-46dc-a58d-69ed0f872b66 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.259012 Jun 14 19:43:12.642760 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 95/197] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:12 2022] GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:13.014068 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-643c4460-8a1a-486d-a8a0-8fd9bf6de52d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:13.014686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-643c4460-8a1a-486d-a8a0-8fd9bf6de52d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:13.022371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-643c4460-8a1a-486d-a8a0-8fd9bf6de52d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:13.022834 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-643c4460-8a1a-486d-a8a0-8fd9bf6de52d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:13.024132 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-643c4460-8a1a-486d-a8a0-8fd9bf6de52d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:13.024590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-643c4460-8a1a-486d-a8a0-8fd9bf6de52d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:13.266335 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-643c4460-8a1a-486d-a8a0-8fd9bf6de52d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:13.279900 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-643c4460-8a1a-486d-a8a0-8fd9bf6de52d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.267676 Jun 14 19:43:13.282361 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 103/198] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:13 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:13.659191 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-547b2a94-cbf2-457c-bdc0-b09ff61415ab tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:13.660098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-547b2a94-cbf2-457c-bdc0-b09ff61415ab tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:13.667143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-547b2a94-cbf2-457c-bdc0-b09ff61415ab tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:13.667591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-547b2a94-cbf2-457c-bdc0-b09ff61415ab tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:13.668361 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-547b2a94-cbf2-457c-bdc0-b09ff61415ab tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:13.668803 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-547b2a94-cbf2-457c-bdc0-b09ff61415ab tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:13.862502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-547b2a94-cbf2-457c-bdc0-b09ff61415ab tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:13.871572 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-547b2a94-cbf2-457c-bdc0-b09ff61415ab tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.216380 Jun 14 19:43:13.872958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 96/199] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:13 2022] GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:14.298896 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3826da7c-c2bf-46af-b297-107353c433e0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:14.300360 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3826da7c-c2bf-46af-b297-107353c433e0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:14.308982 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3826da7c-c2bf-46af-b297-107353c433e0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:14.309913 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3826da7c-c2bf-46af-b297-107353c433e0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:14.310857 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3826da7c-c2bf-46af-b297-107353c433e0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:14.311427 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3826da7c-c2bf-46af-b297-107353c433e0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:14.462511 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3826da7c-c2bf-46af-b297-107353c433e0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:14.471400 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3826da7c-c2bf-46af-b297-107353c433e0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.176368 Jun 14 19:43:14.472058 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 104/200] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:14 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:14.890213 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-074eac7f-e3fd-48f1-905f-7f2830e7be93 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:14.890926 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-074eac7f-e3fd-48f1-905f-7f2830e7be93 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:14.898209 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=76 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:14.900083 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-074eac7f-e3fd-48f1-905f-7f2830e7be93 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:14.900710 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-074eac7f-e3fd-48f1-905f-7f2830e7be93 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:14.901714 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-074eac7f-e3fd-48f1-905f-7f2830e7be93 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:14.902359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-074eac7f-e3fd-48f1-905f-7f2830e7be93 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:15.085326 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-074eac7f-e3fd-48f1-905f-7f2830e7be93 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:15.097639 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-074eac7f-e3fd-48f1-905f-7f2830e7be93 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.212948 Jun 14 19:43:15.110654 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 97/201] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:14 2022] GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:15.172882 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-60668362-6368-407a-809d-5f9611d21f80 req-4f58c654-e958-4eb3-928b-651dbfb7c22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0963b81-0245-424c-a0df-f8605d5e3ae6", "name": "network-vif-plugged", "status": "completed", "tag": "863c8a4a-1808-4ca8-9b31-e9614048af5e"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:43:15.182103 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-60668362-6368-407a-809d-5f9611d21f80 req-4f58c654-e958-4eb3-928b-651dbfb7c22c service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:15.182711 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-60668362-6368-407a-809d-5f9611d21f80 req-4f58c654-e958-4eb3-928b-651dbfb7c22c service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:15.197309 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-60668362-6368-407a-809d-5f9611d21f80 req-4f58c654-e958-4eb3-928b-651dbfb7c22c service nova] Creating event network-vif-plugged:863c8a4a-1808-4ca8-9b31-e9614048af5e for instance f0963b81-0245-424c-a0df-f8605d5e3ae6 on hv-cinder-84580 Jun 14 19:43:15.203447 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-60668362-6368-407a-809d-5f9611d21f80 req-4f58c654-e958-4eb3-928b-651dbfb7c22c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035516 Jun 14 19:43:15.204492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 105/202] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:43:15.488165 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-fcf7cd17-440d-4358-b553-3348105113e9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:15.488782 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-fcf7cd17-440d-4358-b553-3348105113e9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:15.499249 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fcf7cd17-440d-4358-b553-3348105113e9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:15.499705 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fcf7cd17-440d-4358-b553-3348105113e9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:15.500490 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fcf7cd17-440d-4358-b553-3348105113e9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:15.500923 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fcf7cd17-440d-4358-b553-3348105113e9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:15.693944 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-fcf7cd17-440d-4358-b553-3348105113e9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:15.712861 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-fcf7cd17-440d-4358-b553-3348105113e9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.228451 Jun 14 19:43:15.713398 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 98/203] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:15 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:16.127846 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-10188b47-f078-46eb-965e-cc39b929d583 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:16.128548 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-10188b47-f078-46eb-965e-cc39b929d583 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:16.135836 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-10188b47-f078-46eb-965e-cc39b929d583 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:16.136221 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-10188b47-f078-46eb-965e-cc39b929d583 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:16.136993 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-10188b47-f078-46eb-965e-cc39b929d583 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:16.137457 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-10188b47-f078-46eb-965e-cc39b929d583 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:16.271318 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-10188b47-f078-46eb-965e-cc39b929d583 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:16.279021 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-10188b47-f078-46eb-965e-cc39b929d583 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.155146 Jun 14 19:43:16.279589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 106/204] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:16 2022] GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:16.730838 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-e398342e-1cfe-44e6-bea1-45d9fe913274 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:16.731452 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-e398342e-1cfe-44e6-bea1-45d9fe913274 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:16.737989 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e398342e-1cfe-44e6-bea1-45d9fe913274 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:16.738489 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e398342e-1cfe-44e6-bea1-45d9fe913274 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:16.739356 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e398342e-1cfe-44e6-bea1-45d9fe913274 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:16.739883 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e398342e-1cfe-44e6-bea1-45d9fe913274 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:16.871013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e398342e-1cfe-44e6-bea1-45d9fe913274 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:16.878690 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-e398342e-1cfe-44e6-bea1-45d9fe913274 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.152433 Jun 14 19:43:16.879255 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 99/205] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:16 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:17.300129 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9a556e76-582e-4f8a-a996-152c780cefe1 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:17.300904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9a556e76-582e-4f8a-a996-152c780cefe1 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:17.309615 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9a556e76-582e-4f8a-a996-152c780cefe1 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:17.312861 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9a556e76-582e-4f8a-a996-152c780cefe1 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:17.313803 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9a556e76-582e-4f8a-a996-152c780cefe1 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:17.314607 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9a556e76-582e-4f8a-a996-152c780cefe1 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:17.449415 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:17.466317 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=6 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:17.489789 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9a556e76-582e-4f8a-a996-152c780cefe1 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:17.497762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9a556e76-582e-4f8a-a996-152c780cefe1 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6" status: 200 len: 1314 microversion: 2.1 time: 0.205103 Jun 14 19:43:17.498326 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 107/206] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:17 2022] GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:17.895326 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-fef8ea11-5ad9-41ce-9267-043710aa5192 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:17.895943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-fef8ea11-5ad9-41ce-9267-043710aa5192 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:17.897866 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:17.904754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fef8ea11-5ad9-41ce-9267-043710aa5192 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:17.905208 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fef8ea11-5ad9-41ce-9267-043710aa5192 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:17.906269 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fef8ea11-5ad9-41ce-9267-043710aa5192 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:17.906707 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fef8ea11-5ad9-41ce-9267-043710aa5192 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:18.038047 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-fef8ea11-5ad9-41ce-9267-043710aa5192 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:18.045727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-fef8ea11-5ad9-41ce-9267-043710aa5192 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.154191 Jun 14 19:43:18.046296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 100/207] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:17 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:18.514647 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-7a9a4b51-a621-48a9-ba93-75f897e46a95 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:18.515257 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-7a9a4b51-a621-48a9-ba93-75f897e46a95 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:18.522451 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7a9a4b51-a621-48a9-ba93-75f897e46a95 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:18.523251 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7a9a4b51-a621-48a9-ba93-75f897e46a95 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:18.524024 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7a9a4b51-a621-48a9-ba93-75f897e46a95 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:18.524758 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7a9a4b51-a621-48a9-ba93-75f897e46a95 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:18.688988 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-7a9a4b51-a621-48a9-ba93-75f897e46a95 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:18.697335 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-7a9a4b51-a621-48a9-ba93-75f897e46a95 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6" status: 200 len: 1497 microversion: 2.1 time: 0.186191 Jun 14 19:43:18.697938 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 108/208] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:18 2022] GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:19.063610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-53a14b53-5d77-48c6-934e-f748dbb0860c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:19.064953 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-53a14b53-5d77-48c6-934e-f748dbb0860c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:19.071163 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-53a14b53-5d77-48c6-934e-f748dbb0860c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:19.071725 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-53a14b53-5d77-48c6-934e-f748dbb0860c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:19.072505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-53a14b53-5d77-48c6-934e-f748dbb0860c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:19.072943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-53a14b53-5d77-48c6-934e-f748dbb0860c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:19.228488 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-53a14b53-5d77-48c6-934e-f748dbb0860c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:19.248408 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-53a14b53-5d77-48c6-934e-f748dbb0860c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.188586 Jun 14 19:43:19.249255 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 101/209] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:19 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:43:19.296922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c6e69b24-cd5c-4261-b459-32644a21c37e tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:19.297574 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c6e69b24-cd5c-4261-b459-32644a21c37e tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:19.307166 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c6e69b24-cd5c-4261-b459-32644a21c37e tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:19.307922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c6e69b24-cd5c-4261-b459-32644a21c37e tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:19.309606 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c6e69b24-cd5c-4261-b459-32644a21c37e tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:19.310139 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c6e69b24-cd5c-4261-b459-32644a21c37e tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:19.339246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c6e69b24-cd5c-4261-b459-32644a21c37e tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Going to try to terminate instance {{(pid=124068) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:43:19.435183 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c6e69b24-cd5c-4261-b459-32644a21c37e tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6" status: 204 len: 0 microversion: 2.1 time: 0.141993 Jun 14 19:43:19.435769 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 109/210] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:43:19 2022] DELETE /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:43:19.445327 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4a5b05f4-a8bc-4416-a3ce-5cb5bffb4960 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:19.445966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4a5b05f4-a8bc-4416-a3ce-5cb5bffb4960 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:19.453153 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4a5b05f4-a8bc-4416-a3ce-5cb5bffb4960 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:19.453630 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4a5b05f4-a8bc-4416-a3ce-5cb5bffb4960 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:19.454429 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4a5b05f4-a8bc-4416-a3ce-5cb5bffb4960 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:19.455247 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4a5b05f4-a8bc-4416-a3ce-5cb5bffb4960 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:19.665367 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4a5b05f4-a8bc-4416-a3ce-5cb5bffb4960 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:19.676458 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4a5b05f4-a8bc-4416-a3ce-5cb5bffb4960 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6" status: 200 len: 1503 microversion: 2.1 time: 0.233376 Jun 14 19:43:19.676458 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 102/211] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:19 2022] GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:20.266798 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4d0bb9fe-9f3c-4b27-8fbc-96f504923ce7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:20.267572 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4d0bb9fe-9f3c-4b27-8fbc-96f504923ce7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:20.269774 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:20.278207 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4d0bb9fe-9f3c-4b27-8fbc-96f504923ce7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:20.278659 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4d0bb9fe-9f3c-4b27-8fbc-96f504923ce7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:20.279486 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4d0bb9fe-9f3c-4b27-8fbc-96f504923ce7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:20.279948 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4d0bb9fe-9f3c-4b27-8fbc-96f504923ce7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:20.434202 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4d0bb9fe-9f3c-4b27-8fbc-96f504923ce7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:20.442029 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4d0bb9fe-9f3c-4b27-8fbc-96f504923ce7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.179655 Jun 14 19:43:20.442618 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 110/212] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:20 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:20.693939 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c789c9df-b501-45a6-bdd7-c25b775bf450 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:20.694567 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c789c9df-b501-45a6-bdd7-c25b775bf450 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:20.701180 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c789c9df-b501-45a6-bdd7-c25b775bf450 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:20.701651 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c789c9df-b501-45a6-bdd7-c25b775bf450 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:20.702432 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c789c9df-b501-45a6-bdd7-c25b775bf450 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:20.702859 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c789c9df-b501-45a6-bdd7-c25b775bf450 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:20.841097 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c789c9df-b501-45a6-bdd7-c25b775bf450 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:20.848510 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c789c9df-b501-45a6-bdd7-c25b775bf450 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6" status: 200 len: 1503 microversion: 2.1 time: 0.159028 Jun 14 19:43:20.849065 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 103/213] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:20 2022] GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:21.460327 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1bf7da22-bb33-496d-8b45-1c6a78236448 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:21.460936 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1bf7da22-bb33-496d-8b45-1c6a78236448 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:21.469052 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1bf7da22-bb33-496d-8b45-1c6a78236448 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:21.469633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1bf7da22-bb33-496d-8b45-1c6a78236448 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:21.470757 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1bf7da22-bb33-496d-8b45-1c6a78236448 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:21.471360 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1bf7da22-bb33-496d-8b45-1c6a78236448 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:21.695443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1bf7da22-bb33-496d-8b45-1c6a78236448 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:21.703089 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1bf7da22-bb33-496d-8b45-1c6a78236448 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.246783 Jun 14 19:43:21.712903 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 111/214] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:21 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:21.809336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-fe256a11-37a1-4a70-9382-41ed094c8cc7 req-fafc0117-095e-4d22-bca3-78462e5cb793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0963b81-0245-424c-a0df-f8605d5e3ae6", "name": "network-vif-deleted", "tag": "863c8a4a-1808-4ca8-9b31-e9614048af5e"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:43:21.821975 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-fe256a11-37a1-4a70-9382-41ed094c8cc7 req-fafc0117-095e-4d22-bca3-78462e5cb793 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:21.822413 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-fe256a11-37a1-4a70-9382-41ed094c8cc7 req-fafc0117-095e-4d22-bca3-78462e5cb793 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:21.834002 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-fe256a11-37a1-4a70-9382-41ed094c8cc7 req-fafc0117-095e-4d22-bca3-78462e5cb793 service nova] Creating event network-vif-deleted:863c8a4a-1808-4ca8-9b31-e9614048af5e for instance f0963b81-0245-424c-a0df-f8605d5e3ae6 on hv-cinder-84580 Jun 14 19:43:21.839730 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-fe256a11-37a1-4a70-9382-41ed094c8cc7 req-fafc0117-095e-4d22-bca3-78462e5cb793 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035950 Jun 14 19:43:21.840581 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 104/215] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:43:21.867367 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b66a355a-8059-443a-958f-dd3a78ec0eda tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:21.868823 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b66a355a-8059-443a-958f-dd3a78ec0eda tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:21.876633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b66a355a-8059-443a-958f-dd3a78ec0eda tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:21.877155 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b66a355a-8059-443a-958f-dd3a78ec0eda tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:21.878122 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b66a355a-8059-443a-958f-dd3a78ec0eda tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:21.878694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b66a355a-8059-443a-958f-dd3a78ec0eda tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:21.957130 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b66a355a-8059-443a-958f-dd3a78ec0eda tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:21.966783 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b66a355a-8059-443a-958f-dd3a78ec0eda tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6" status: 200 len: 1299 microversion: 2.1 time: 0.104411 Jun 14 19:43:21.967528 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 112/216] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:21 2022] GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:22.720646 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c9c30d6a-b169-44d6-975a-bc467aa26a53 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:22.721337 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c9c30d6a-b169-44d6-975a-bc467aa26a53 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:22.727786 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c9c30d6a-b169-44d6-975a-bc467aa26a53 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:22.728240 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c9c30d6a-b169-44d6-975a-bc467aa26a53 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:22.729006 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c9c30d6a-b169-44d6-975a-bc467aa26a53 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:22.729470 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c9c30d6a-b169-44d6-975a-bc467aa26a53 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:22.864181 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c9c30d6a-b169-44d6-975a-bc467aa26a53 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:22.872675 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c9c30d6a-b169-44d6-975a-bc467aa26a53 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.156278 Jun 14 19:43:22.873279 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 105/217] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:22 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:22.984135 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9c5112e5-8a70-4037-bc83-3c60e804a0c9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:22.984745 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9c5112e5-8a70-4037-bc83-3c60e804a0c9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: f0963b81-0245-424c-a0df-f8605d5e3ae6] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:22.991347 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c5112e5-8a70-4037-bc83-3c60e804a0c9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:22.991800 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c5112e5-8a70-4037-bc83-3c60e804a0c9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:22.992558 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c5112e5-8a70-4037-bc83-3c60e804a0c9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:22.993001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c5112e5-8a70-4037-bc83-3c60e804a0c9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:23.007131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-9c5112e5-8a70-4037-bc83-3c60e804a0c9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] HTTP exception thrown: Instance f0963b81-0245-424c-a0df-f8605d5e3ae6 could not be found. Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9c5112e5-8a70-4037-bc83-3c60e804a0c9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Request method failure captured: Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 HTTP/1.1 Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOTGjxi2w9_8a9TSustwDoN1a7HvNBwPcmnO26WUJBS1VAscahP62Lq4jDEMvCTgJ13LIHFKaTRsEtx1XdIfjnJwuNgyWm4iPs7U8qGzW5wLVOVJ2HD7MfB4t0XGLq7QCizNSo_37ZM_CzKNT5h6FRahn8o4DNmEKfdcJ0l86p_1YGc Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: cbf704ce7bfd49f5b83ca2e7e0120c91 Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-VolumesActionsTest-1854470073 Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:43:23.008963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:43:23.010323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbf704ce7bfd49f5b83ca2e7e0120c91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cbf704ce7bfd49f5b83ca2e7e0120c91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cbf704ce7bfd49f5b83ca2e7e0120c91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbf704ce7bfd49f5b83ca2e7e0120c91"}]}] Jun 14 19:43:23.010323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-VolumesActionsTest-1854470073 Jun 14 19:43:23.010323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: cbf704ce7bfd49f5b83ca2e7e0120c91 Jun 14 19:43:23.010323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-VolumesActionsTest-1854470073 Jun 14 19:43:23.010323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-VolumesActionsTest-1854470073-project Jun 14 19:43:23.010323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:43:23.010323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:43:23.010323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: de843beff4dd401fb34b34ab83f6f7f3 Jun 14 19:43:23.010323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-VolumesActionsTest-1854470073-project Jun 14 19:43:23.010323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:43:23.010323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance f0963b81-0245-424c-a0df-f8605d5e3ae6 could not be found. Jun 14 19:43:23.010323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': 'f0963b81-0245-424c-a0df-f8605d5e3ae6'} Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0963b81-0245-424c-a0df-f8605d5e3ae6 could not be found. Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:43:23.011137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0963b81-0245-424c-a0df-f8605d5e3ae6 could not be found. Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0963b81-0245-424c-a0df-f8605d5e3ae6 could not be found. Jun 14 19:43:23.012478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:43:23.013659 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9c5112e5-8a70-4037-bc83-3c60e804a0c9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Returning 404 to user: Instance f0963b81-0245-424c-a0df-f8605d5e3ae6 could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:43:23.013659 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9c5112e5-8a70-4037-bc83-3c60e804a0c9 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6" status: 404 len: 111 microversion: 2.1 time: 0.030269 Jun 14 19:43:23.013659 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 113/218] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:22 2022] GET /compute/v2.1/servers/f0963b81-0245-424c-a0df-f8605d5e3ae6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:43:23.107864 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1984390593", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "networks": [{"uuid": "a5591a0a-a877-44a4-9389-1776d51447b2"}]}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:43:23.157498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.network.neutron [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] validate_networks() for [('a5591a0a-a877-44a4-9389-1776d51447b2', None, None, None, None, None)] {{(pid=124069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:43:23.708776 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Flavor limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:43:23.709199 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Image limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:43:23.709693 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Flavor pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:43:23.710096 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Image pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:43:23.710518 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:43:23.720970 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:23.721447 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:23.722244 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:23.722679 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:23.739938 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Getting quotas for project cbf704ce7bfd49f5b83ca2e7e0120c91. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:43:23.743971 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Getting quotas for user de843beff4dd401fb34b34ab83f6f7f3 and project cbf704ce7bfd49f5b83ca2e7e0120c91. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:43:23.755181 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Going to run 1 instances... {{(pid=124069) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:43:23.757472 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:43:23.803957 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b29005be-f17b-49b6-8135-e1297040e26d tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699845 Jun 14 19:43:23.805101 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 106/219] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:43:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:43:23.814634 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-441bfdb0-d4a7-4809-9e78-18eb238f2185 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:23.815237 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-441bfdb0-d4a7-4809-9e78-18eb238f2185 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:23.870553 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-441bfdb0-d4a7-4809-9e78-18eb238f2185 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:23.877498 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-441bfdb0-d4a7-4809-9e78-18eb238f2185 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1214 microversion: 2.1 time: 0.066565 Jun 14 19:43:23.878370 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 114/220] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:23 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:23.890608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-62a9bb5d-476f-48ad-862a-7dc38769730d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:23.891221 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-62a9bb5d-476f-48ad-862a-7dc38769730d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:23.900174 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-62a9bb5d-476f-48ad-862a-7dc38769730d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:23.900574 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-62a9bb5d-476f-48ad-862a-7dc38769730d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:23.901313 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-62a9bb5d-476f-48ad-862a-7dc38769730d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:23.901960 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-62a9bb5d-476f-48ad-862a-7dc38769730d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:24.066049 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-62a9bb5d-476f-48ad-862a-7dc38769730d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:24.074924 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-62a9bb5d-476f-48ad-862a-7dc38769730d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.188467 Jun 14 19:43:24.076263 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 107/221] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:23 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:24.895409 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-488c0bc5-4085-4148-b342-95f582f2e7b5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:24.896019 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-488c0bc5-4085-4148-b342-95f582f2e7b5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:24.902279 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-488c0bc5-4085-4148-b342-95f582f2e7b5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:24.902742 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-488c0bc5-4085-4148-b342-95f582f2e7b5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:24.903536 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-488c0bc5-4085-4148-b342-95f582f2e7b5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:24.903968 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-488c0bc5-4085-4148-b342-95f582f2e7b5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:24.963913 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-488c0bc5-4085-4148-b342-95f582f2e7b5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:24.971235 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-488c0bc5-4085-4148-b342-95f582f2e7b5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1218 microversion: 2.1 time: 0.079709 Jun 14 19:43:24.971787 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 115/222] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:24 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:25.094061 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-117c5e8f-a776-48fb-9397-5a45806cc428 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:25.094672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-117c5e8f-a776-48fb-9397-5a45806cc428 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:25.101505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-117c5e8f-a776-48fb-9397-5a45806cc428 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:25.102031 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-117c5e8f-a776-48fb-9397-5a45806cc428 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:25.102861 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-117c5e8f-a776-48fb-9397-5a45806cc428 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:25.103298 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-117c5e8f-a776-48fb-9397-5a45806cc428 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:25.233024 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-117c5e8f-a776-48fb-9397-5a45806cc428 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:25.240465 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-117c5e8f-a776-48fb-9397-5a45806cc428 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.150491 Jun 14 19:43:25.241040 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 108/223] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:25 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:25.988365 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-da38eb7d-5ccf-4c76-84cc-c3199ab65527 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:25.988966 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-da38eb7d-5ccf-4c76-84cc-c3199ab65527 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:25.995541 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-da38eb7d-5ccf-4c76-84cc-c3199ab65527 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:25.995983 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-da38eb7d-5ccf-4c76-84cc-c3199ab65527 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:25.996730 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-da38eb7d-5ccf-4c76-84cc-c3199ab65527 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:25.997151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-da38eb7d-5ccf-4c76-84cc-c3199ab65527 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:26.057869 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-da38eb7d-5ccf-4c76-84cc-c3199ab65527 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:26.065088 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-da38eb7d-5ccf-4c76-84cc-c3199ab65527 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1218 microversion: 2.1 time: 0.080549 Jun 14 19:43:26.065669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 116/224] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:25 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:26.257836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-55947858-e874-47ae-8c19-ca435617f198 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:26.258357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-55947858-e874-47ae-8c19-ca435617f198 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:26.265398 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-55947858-e874-47ae-8c19-ca435617f198 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:26.265845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-55947858-e874-47ae-8c19-ca435617f198 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:26.266590 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-55947858-e874-47ae-8c19-ca435617f198 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:26.267016 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-55947858-e874-47ae-8c19-ca435617f198 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:26.399954 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-55947858-e874-47ae-8c19-ca435617f198 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:26.402463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=100 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:26.409344 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-55947858-e874-47ae-8c19-ca435617f198 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.155401 Jun 14 19:43:26.409924 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 109/225] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:26 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:27.082534 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-2dd5581f-c39f-486c-a96c-405980796a87 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:27.084047 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-2dd5581f-c39f-486c-a96c-405980796a87 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:27.090899 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2dd5581f-c39f-486c-a96c-405980796a87 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:27.091508 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2dd5581f-c39f-486c-a96c-405980796a87 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:27.092495 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2dd5581f-c39f-486c-a96c-405980796a87 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:27.093031 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2dd5581f-c39f-486c-a96c-405980796a87 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:27.170388 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-2dd5581f-c39f-486c-a96c-405980796a87 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:27.178898 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-2dd5581f-c39f-486c-a96c-405980796a87 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1266 microversion: 2.1 time: 0.100096 Jun 14 19:43:27.179820 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 117/226] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:27 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:27.427406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b9fcb2e7-de0b-4d90-8eb3-c536182fac51 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:27.428930 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b9fcb2e7-de0b-4d90-8eb3-c536182fac51 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:27.437389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b9fcb2e7-de0b-4d90-8eb3-c536182fac51 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:27.437916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b9fcb2e7-de0b-4d90-8eb3-c536182fac51 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:27.438694 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b9fcb2e7-de0b-4d90-8eb3-c536182fac51 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:27.439335 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b9fcb2e7-de0b-4d90-8eb3-c536182fac51 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:27.575315 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-b9fcb2e7-de0b-4d90-8eb3-c536182fac51 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:27.582829 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b9fcb2e7-de0b-4d90-8eb3-c536182fac51 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.159998 Jun 14 19:43:27.583393 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 110/227] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:27 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:28.197514 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-8cd71971-a866-42f7-a677-4fa87dcadcd5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:28.198263 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8cd71971-a866-42f7-a677-4fa87dcadcd5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:28.205025 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8cd71971-a866-42f7-a677-4fa87dcadcd5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:28.205537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8cd71971-a866-42f7-a677-4fa87dcadcd5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:28.206323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8cd71971-a866-42f7-a677-4fa87dcadcd5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:28.206758 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8cd71971-a866-42f7-a677-4fa87dcadcd5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:28.440188 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-8cd71971-a866-42f7-a677-4fa87dcadcd5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:28.448511 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-8cd71971-a866-42f7-a677-4fa87dcadcd5 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1314 microversion: 2.1 time: 0.255203 Jun 14 19:43:28.449159 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 118/228] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:28 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:28.594793 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-4c1bfdd2-b178-40cb-ada0-99d6e2f70ab8 req-60759967-1b5c-4412-98b5-32f5db902e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29badaf3-597c-4a1e-ba08-008aa9774486", "tag": "874822ac-b13b-4f2e-8208-788759ce1f69"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:43:28.600572 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-429e0724-5a13-4264-a6ff-f8de0eaf87cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:28.601507 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-429e0724-5a13-4264-a6ff-f8de0eaf87cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:28.613490 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-429e0724-5a13-4264-a6ff-f8de0eaf87cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:28.616348 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-429e0724-5a13-4264-a6ff-f8de0eaf87cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:28.620176 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-429e0724-5a13-4264-a6ff-f8de0eaf87cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:28.621117 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-429e0724-5a13-4264-a6ff-f8de0eaf87cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:28.622478 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-4c1bfdd2-b178-40cb-ada0-99d6e2f70ab8 req-60759967-1b5c-4412-98b5-32f5db902e4a service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:28.623123 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-4c1bfdd2-b178-40cb-ada0-99d6e2f70ab8 req-60759967-1b5c-4412-98b5-32f5db902e4a service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:28.624294 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:28.636638 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-4c1bfdd2-b178-40cb-ada0-99d6e2f70ab8 req-60759967-1b5c-4412-98b5-32f5db902e4a service nova] Creating event network-changed:874822ac-b13b-4f2e-8208-788759ce1f69 for instance 29badaf3-597c-4a1e-ba08-008aa9774486 on hv-cinder-84580 Jun 14 19:43:28.643791 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-4c1bfdd2-b178-40cb-ada0-99d6e2f70ab8 req-60759967-1b5c-4412-98b5-32f5db902e4a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051234 Jun 14 19:43:28.645551 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 111/229] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:43:28.868809 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-429e0724-5a13-4264-a6ff-f8de0eaf87cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:28.877270 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-429e0724-5a13-4264-a6ff-f8de0eaf87cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.280819 Jun 14 19:43:28.877942 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 119/230] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:28 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:29.467046 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ef6a8a2b-73d3-4db6-b8fd-8426f993c534 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:29.467861 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ef6a8a2b-73d3-4db6-b8fd-8426f993c534 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:29.474210 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ef6a8a2b-73d3-4db6-b8fd-8426f993c534 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:29.474664 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ef6a8a2b-73d3-4db6-b8fd-8426f993c534 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:29.475426 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ef6a8a2b-73d3-4db6-b8fd-8426f993c534 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:29.475861 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ef6a8a2b-73d3-4db6-b8fd-8426f993c534 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:29.614146 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-ef6a8a2b-73d3-4db6-b8fd-8426f993c534 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:29.622533 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-ef6a8a2b-73d3-4db6-b8fd-8426f993c534 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1314 microversion: 2.1 time: 0.160621 Jun 14 19:43:29.622984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 112/231] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:29 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:29.895148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4ebe6317-c9f1-4343-ab5c-87655ed057ca tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:29.896335 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4ebe6317-c9f1-4343-ab5c-87655ed057ca tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:29.903018 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4ebe6317-c9f1-4343-ab5c-87655ed057ca tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:29.903711 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4ebe6317-c9f1-4343-ab5c-87655ed057ca tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:29.904484 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4ebe6317-c9f1-4343-ab5c-87655ed057ca tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:29.905313 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4ebe6317-c9f1-4343-ab5c-87655ed057ca tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:30.125148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4ebe6317-c9f1-4343-ab5c-87655ed057ca tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:30.133149 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4ebe6317-c9f1-4343-ab5c-87655ed057ca tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.242325 Jun 14 19:43:30.143627 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 120/232] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:29 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:30.642073 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ba32b3ca-f730-4c8f-8bf9-dd5f6a9308e0 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:30.642874 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ba32b3ca-f730-4c8f-8bf9-dd5f6a9308e0 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:30.651779 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ba32b3ca-f730-4c8f-8bf9-dd5f6a9308e0 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:30.652488 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ba32b3ca-f730-4c8f-8bf9-dd5f6a9308e0 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:30.653464 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ba32b3ca-f730-4c8f-8bf9-dd5f6a9308e0 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:30.654324 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ba32b3ca-f730-4c8f-8bf9-dd5f6a9308e0 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:30.798492 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-ba32b3ca-f730-4c8f-8bf9-dd5f6a9308e0 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:30.806221 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-ba32b3ca-f730-4c8f-8bf9-dd5f6a9308e0 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1314 microversion: 2.1 time: 0.169918 Jun 14 19:43:30.806800 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 113/233] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:30 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:31.152056 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1442cc62-2625-4493-8fe7-a62d02ea289f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:31.152796 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1442cc62-2625-4493-8fe7-a62d02ea289f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:31.159286 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1442cc62-2625-4493-8fe7-a62d02ea289f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:31.159965 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1442cc62-2625-4493-8fe7-a62d02ea289f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:31.160923 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1442cc62-2625-4493-8fe7-a62d02ea289f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:31.161607 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1442cc62-2625-4493-8fe7-a62d02ea289f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:31.317897 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1442cc62-2625-4493-8fe7-a62d02ea289f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:31.326423 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1442cc62-2625-4493-8fe7-a62d02ea289f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.179487 Jun 14 19:43:31.326987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 121/234] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:31 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:31.825003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-537414b2-ab1e-483f-bdd3-5bbb4f4044a4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:31.825936 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-537414b2-ab1e-483f-bdd3-5bbb4f4044a4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:31.837080 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-537414b2-ab1e-483f-bdd3-5bbb4f4044a4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:31.838767 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-537414b2-ab1e-483f-bdd3-5bbb4f4044a4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:31.839596 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-537414b2-ab1e-483f-bdd3-5bbb4f4044a4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:31.840253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-537414b2-ab1e-483f-bdd3-5bbb4f4044a4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:32.139583 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-537414b2-ab1e-483f-bdd3-5bbb4f4044a4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:32.163162 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-537414b2-ab1e-483f-bdd3-5bbb4f4044a4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1314 microversion: 2.1 time: 0.340991 Jun 14 19:43:32.165943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 114/235] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:31 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:32.343955 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-542b9de5-7a18-40ce-90bb-e7f618c29be2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:32.344557 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-542b9de5-7a18-40ce-90bb-e7f618c29be2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:32.351444 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-542b9de5-7a18-40ce-90bb-e7f618c29be2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:32.351969 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-542b9de5-7a18-40ce-90bb-e7f618c29be2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:32.352930 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-542b9de5-7a18-40ce-90bb-e7f618c29be2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:32.354175 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-542b9de5-7a18-40ce-90bb-e7f618c29be2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:32.496607 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-542b9de5-7a18-40ce-90bb-e7f618c29be2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:32.504121 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-542b9de5-7a18-40ce-90bb-e7f618c29be2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.163982 Jun 14 19:43:32.504855 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 122/236] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:32 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:33.181587 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-e3b52182-4695-440d-a605-29238c9b90f4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:33.183070 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-e3b52182-4695-440d-a605-29238c9b90f4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:33.191907 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e3b52182-4695-440d-a605-29238c9b90f4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:33.192649 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e3b52182-4695-440d-a605-29238c9b90f4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:33.193650 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e3b52182-4695-440d-a605-29238c9b90f4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:33.194626 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e3b52182-4695-440d-a605-29238c9b90f4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:33.296510 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-2b88afbc-6b05-448c-8231-fb3defc16e2b req-14c89e27-dc2c-45cd-992f-f7a9b391980a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29badaf3-597c-4a1e-ba08-008aa9774486", "name": "network-vif-plugged", "status": "completed", "tag": "874822ac-b13b-4f2e-8208-788759ce1f69"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:43:33.309885 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-2b88afbc-6b05-448c-8231-fb3defc16e2b req-14c89e27-dc2c-45cd-992f-f7a9b391980a service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:33.310823 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-2b88afbc-6b05-448c-8231-fb3defc16e2b req-14c89e27-dc2c-45cd-992f-f7a9b391980a service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:33.324571 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-2b88afbc-6b05-448c-8231-fb3defc16e2b req-14c89e27-dc2c-45cd-992f-f7a9b391980a service nova] Creating event network-vif-plugged:874822ac-b13b-4f2e-8208-788759ce1f69 for instance 29badaf3-597c-4a1e-ba08-008aa9774486 on hv-cinder-84580 Jun 14 19:43:33.333836 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-2b88afbc-6b05-448c-8231-fb3defc16e2b req-14c89e27-dc2c-45cd-992f-f7a9b391980a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040963 Jun 14 19:43:33.335553 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 123/237] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:43:33.393220 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e3b52182-4695-440d-a605-29238c9b90f4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:33.402489 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-e3b52182-4695-440d-a605-29238c9b90f4 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1314 microversion: 2.1 time: 0.225440 Jun 14 19:43:33.403861 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 115/238] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:33 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:33.522061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-da2598cc-f8a9-4ffa-8111-1e5730c55b14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:33.522758 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-da2598cc-f8a9-4ffa-8111-1e5730c55b14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:33.530800 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-da2598cc-f8a9-4ffa-8111-1e5730c55b14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:33.531252 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-da2598cc-f8a9-4ffa-8111-1e5730c55b14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:33.532014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-da2598cc-f8a9-4ffa-8111-1e5730c55b14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:33.532453 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-da2598cc-f8a9-4ffa-8111-1e5730c55b14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:33.681271 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-da2598cc-f8a9-4ffa-8111-1e5730c55b14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:33.689943 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-da2598cc-f8a9-4ffa-8111-1e5730c55b14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1520 microversion: 2.1 time: 0.172153 Jun 14 19:43:33.699292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 124/239] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:33 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:34.419814 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-07e51765-656c-4c5e-b583-9054aa3fa959 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:34.420422 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-07e51765-656c-4c5e-b583-9054aa3fa959 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:34.422490 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:34.423146 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=6 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:34.429393 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-07e51765-656c-4c5e-b583-9054aa3fa959 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:34.429875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-07e51765-656c-4c5e-b583-9054aa3fa959 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:34.430817 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-07e51765-656c-4c5e-b583-9054aa3fa959 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:34.431260 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-07e51765-656c-4c5e-b583-9054aa3fa959 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:34.565309 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-07e51765-656c-4c5e-b583-9054aa3fa959 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:34.573745 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-07e51765-656c-4c5e-b583-9054aa3fa959 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1314 microversion: 2.1 time: 0.157595 Jun 14 19:43:34.574224 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 116/240] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:34 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:34.706727 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b0f81ca6-dbba-4aad-b26a-5c71792fc71e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:34.707335 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b0f81ca6-dbba-4aad-b26a-5c71792fc71e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:34.709288 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:34.714866 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b0f81ca6-dbba-4aad-b26a-5c71792fc71e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:34.715320 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b0f81ca6-dbba-4aad-b26a-5c71792fc71e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:34.716085 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b0f81ca6-dbba-4aad-b26a-5c71792fc71e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:34.716522 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b0f81ca6-dbba-4aad-b26a-5c71792fc71e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:34.852794 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b0f81ca6-dbba-4aad-b26a-5c71792fc71e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:34.860365 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b0f81ca6-dbba-4aad-b26a-5c71792fc71e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1500 microversion: 2.1 time: 0.157442 Jun 14 19:43:34.861166 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 125/241] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:34 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:34.879504 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d67d6ea4-92a6-42bb-9e10-5b5483420654 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:34.880260 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d67d6ea4-92a6-42bb-9e10-5b5483420654 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:34.887365 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d67d6ea4-92a6-42bb-9e10-5b5483420654 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:34.888090 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d67d6ea4-92a6-42bb-9e10-5b5483420654 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:34.888928 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d67d6ea4-92a6-42bb-9e10-5b5483420654 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:34.889514 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d67d6ea4-92a6-42bb-9e10-5b5483420654 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:35.044499 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d67d6ea4-92a6-42bb-9e10-5b5483420654 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:35.052506 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d67d6ea4-92a6-42bb-9e10-5b5483420654 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1515 microversion: 2.1 time: 0.178575 Jun 14 19:43:35.053601 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 117/242] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:34 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:35.591734 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e641dbbf-68eb-4967-864e-329263f4b465 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:35.592447 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e641dbbf-68eb-4967-864e-329263f4b465 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:35.604349 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e641dbbf-68eb-4967-864e-329263f4b465 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:35.604810 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e641dbbf-68eb-4967-864e-329263f4b465 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:35.605633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e641dbbf-68eb-4967-864e-329263f4b465 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:35.606065 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e641dbbf-68eb-4967-864e-329263f4b465 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:35.758802 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-e641dbbf-68eb-4967-864e-329263f4b465 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:35.766739 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e641dbbf-68eb-4967-864e-329263f4b465 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1314 microversion: 2.1 time: 0.180263 Jun 14 19:43:35.767330 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 126/243] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:35 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:36.468973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-5afe38e4-4ed6-4caf-97b0-8a822b056996 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:43:36.470557 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-5afe38e4-4ed6-4caf-97b0-8a822b056996 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:36.480008 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5afe38e4-4ed6-4caf-97b0-8a822b056996 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:36.480488 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5afe38e4-4ed6-4caf-97b0-8a822b056996 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:36.481258 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5afe38e4-4ed6-4caf-97b0-8a822b056996 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:36.481716 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5afe38e4-4ed6-4caf-97b0-8a822b056996 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:36.506668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.objects.instance [None req-5afe38e4-4ed6-4caf-97b0-8a822b056996 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lazy-loading 'flavor' on Instance uuid 26a2c03a-7157-4585-b388-ae3fbf9913cb {{(pid=124069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:43:36.599515 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-5afe38e4-4ed6-4caf-97b0-8a822b056996 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "POST /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb/action" status: 200 len: 32 microversion: 2.1 time: 0.136094 Jun 14 19:43:36.599515 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 118/244] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 14 19:43:36 2022] POST /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb/action => generated 32 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 19:43:36.611390 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-cc50b456-489b-4000-b3db-a2cf80944f13 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:36.612064 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-cc50b456-489b-4000-b3db-a2cf80944f13 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:36.619960 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cc50b456-489b-4000-b3db-a2cf80944f13 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:36.620905 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cc50b456-489b-4000-b3db-a2cf80944f13 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:36.621854 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cc50b456-489b-4000-b3db-a2cf80944f13 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:36.622376 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cc50b456-489b-4000-b3db-a2cf80944f13 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:36.785320 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9931b3fe-7f7e-4c3c-a5b7-68917953ef43 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:36.786052 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9931b3fe-7f7e-4c3c-a5b7-68917953ef43 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:36.794280 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9931b3fe-7f7e-4c3c-a5b7-68917953ef43 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:36.794915 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9931b3fe-7f7e-4c3c-a5b7-68917953ef43 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:36.795878 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9931b3fe-7f7e-4c3c-a5b7-68917953ef43 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:36.796282 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9931b3fe-7f7e-4c3c-a5b7-68917953ef43 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:36.917812 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-cc50b456-489b-4000-b3db-a2cf80944f13 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:36.927028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-cc50b456-489b-4000-b3db-a2cf80944f13 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.320533 Jun 14 19:43:36.927836 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 127/245] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:36 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:36.948109 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9931b3fe-7f7e-4c3c-a5b7-68917953ef43 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:36.955908 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9931b3fe-7f7e-4c3c-a5b7-68917953ef43 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1496 microversion: 2.1 time: 0.174914 Jun 14 19:43:36.956486 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 119/246] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:36 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1496 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:43:37.429276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-8562d819-71d9-43c9-8b5e-b18f841d405a tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:37.429855 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8562d819-71d9-43c9-8b5e-b18f841d405a tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:37.436089 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8562d819-71d9-43c9-8b5e-b18f841d405a tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:37.436545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8562d819-71d9-43c9-8b5e-b18f841d405a tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:37.437312 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8562d819-71d9-43c9-8b5e-b18f841d405a tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:37.437771 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8562d819-71d9-43c9-8b5e-b18f841d405a tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:37.464892 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8562d819-71d9-43c9-8b5e-b18f841d405a tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Going to try to terminate instance {{(pid=124068) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:43:37.547649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-8562d819-71d9-43c9-8b5e-b18f841d405a tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "DELETE /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 204 len: 0 microversion: 2.1 time: 0.121839 Jun 14 19:43:37.548289 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 128/247] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:43:37 2022] DELETE /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:43:37.557314 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8155a413-7e56-4159-b4f8-de9862805541 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:37.557963 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8155a413-7e56-4159-b4f8-de9862805541 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:37.565281 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8155a413-7e56-4159-b4f8-de9862805541 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:37.566055 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8155a413-7e56-4159-b4f8-de9862805541 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:37.567075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8155a413-7e56-4159-b4f8-de9862805541 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:37.567701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8155a413-7e56-4159-b4f8-de9862805541 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:37.705941 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8155a413-7e56-4159-b4f8-de9862805541 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:37.714026 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8155a413-7e56-4159-b4f8-de9862805541 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1502 microversion: 2.1 time: 0.160708 Jun 14 19:43:37.714871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 120/248] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:37 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:37.948064 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0ea94dd6-8bfe-45be-8c43-11e5a067bdce tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:37.948854 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-0ea94dd6-8bfe-45be-8c43-11e5a067bdce tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:37.955170 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0ea94dd6-8bfe-45be-8c43-11e5a067bdce tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:37.955796 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0ea94dd6-8bfe-45be-8c43-11e5a067bdce tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:37.956606 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0ea94dd6-8bfe-45be-8c43-11e5a067bdce tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:37.956973 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0ea94dd6-8bfe-45be-8c43-11e5a067bdce tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:38.095986 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0ea94dd6-8bfe-45be-8c43-11e5a067bdce tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:38.104376 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-0ea94dd6-8bfe-45be-8c43-11e5a067bdce tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.161305 Jun 14 19:43:38.104942 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 129/249] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:37 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:38.732839 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-43319839-c640-4c2e-ad10-9c496f0e97d3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:38.733489 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-43319839-c640-4c2e-ad10-9c496f0e97d3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:38.739914 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-43319839-c640-4c2e-ad10-9c496f0e97d3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:38.740365 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-43319839-c640-4c2e-ad10-9c496f0e97d3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:38.741129 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-43319839-c640-4c2e-ad10-9c496f0e97d3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:38.741604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-43319839-c640-4c2e-ad10-9c496f0e97d3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:38.879145 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-43319839-c640-4c2e-ad10-9c496f0e97d3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:38.887196 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-43319839-c640-4c2e-ad10-9c496f0e97d3 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1502 microversion: 2.1 time: 0.158195 Jun 14 19:43:38.889898 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 121/250] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:38 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:43:39.122206 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-bc0a75c8-7071-457e-a7d6-59a3153b59f5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:39.122758 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-bc0a75c8-7071-457e-a7d6-59a3153b59f5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:39.129074 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-bc0a75c8-7071-457e-a7d6-59a3153b59f5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:39.129592 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-bc0a75c8-7071-457e-a7d6-59a3153b59f5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:39.130354 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-bc0a75c8-7071-457e-a7d6-59a3153b59f5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:39.130785 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-bc0a75c8-7071-457e-a7d6-59a3153b59f5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:39.264066 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-bc0a75c8-7071-457e-a7d6-59a3153b59f5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:39.271444 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-bc0a75c8-7071-457e-a7d6-59a3153b59f5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.153288 Jun 14 19:43:39.272012 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 130/251] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:39 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:39.905254 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b964a810-e143-4c82-98c3-5dc0b255a24b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:39.906694 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b964a810-e143-4c82-98c3-5dc0b255a24b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:39.913004 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b964a810-e143-4c82-98c3-5dc0b255a24b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:39.913490 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b964a810-e143-4c82-98c3-5dc0b255a24b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:39.914888 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b964a810-e143-4c82-98c3-5dc0b255a24b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:39.915320 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b964a810-e143-4c82-98c3-5dc0b255a24b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:40.085216 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-b964a810-e143-4c82-98c3-5dc0b255a24b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:40.093979 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b964a810-e143-4c82-98c3-5dc0b255a24b tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1502 microversion: 2.1 time: 0.192821 Jun 14 19:43:40.094863 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 122/252] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:39 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:40.288007 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3d49a539-9686-4f88-a627-cc36cec78c22 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:40.288746 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3d49a539-9686-4f88-a627-cc36cec78c22 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:40.299752 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3d49a539-9686-4f88-a627-cc36cec78c22 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:40.300209 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3d49a539-9686-4f88-a627-cc36cec78c22 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:40.301522 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3d49a539-9686-4f88-a627-cc36cec78c22 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:40.301964 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3d49a539-9686-4f88-a627-cc36cec78c22 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:40.433890 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3d49a539-9686-4f88-a627-cc36cec78c22 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:40.441209 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3d49a539-9686-4f88-a627-cc36cec78c22 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.156968 Jun 14 19:43:40.441803 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 131/253] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:40 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:41.112468 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-5a371c60-48e1-4b49-82fd-e7b504c0c964 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:41.113234 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-5a371c60-48e1-4b49-82fd-e7b504c0c964 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:41.121788 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5a371c60-48e1-4b49-82fd-e7b504c0c964 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:41.121788 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5a371c60-48e1-4b49-82fd-e7b504c0c964 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:41.121788 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5a371c60-48e1-4b49-82fd-e7b504c0c964 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:41.122446 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5a371c60-48e1-4b49-82fd-e7b504c0c964 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:41.264023 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-5a371c60-48e1-4b49-82fd-e7b504c0c964 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:41.271393 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-5a371c60-48e1-4b49-82fd-e7b504c0c964 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1502 microversion: 2.1 time: 0.163114 Jun 14 19:43:41.271955 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 123/254] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:41 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:41.458378 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-feb29b36-dfbb-4da7-8ee1-6774cdf3df71 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:41.459003 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-feb29b36-dfbb-4da7-8ee1-6774cdf3df71 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:41.465424 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-feb29b36-dfbb-4da7-8ee1-6774cdf3df71 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:41.465872 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-feb29b36-dfbb-4da7-8ee1-6774cdf3df71 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:41.466645 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-feb29b36-dfbb-4da7-8ee1-6774cdf3df71 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:41.467069 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-feb29b36-dfbb-4da7-8ee1-6774cdf3df71 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:41.597262 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-feb29b36-dfbb-4da7-8ee1-6774cdf3df71 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:41.605254 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-feb29b36-dfbb-4da7-8ee1-6774cdf3df71 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.150666 Jun 14 19:43:41.605850 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 132/255] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:41 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:42.288101 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-44168434-6246-4035-aa5a-50220db33857 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:42.288701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-44168434-6246-4035-aa5a-50220db33857 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:42.295760 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-44168434-6246-4035-aa5a-50220db33857 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:42.296204 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-44168434-6246-4035-aa5a-50220db33857 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:42.296960 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-44168434-6246-4035-aa5a-50220db33857 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:42.297402 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-44168434-6246-4035-aa5a-50220db33857 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:42.436805 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-44168434-6246-4035-aa5a-50220db33857 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de843beff4dd401fb34b34ab83f6f7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:42.444890 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-44168434-6246-4035-aa5a-50220db33857 tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 200 len: 1502 microversion: 2.1 time: 0.160652 Jun 14 19:43:42.446225 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 124/256] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:42 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:42.622250 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c9d8a847-65fb-43d3-bcd2-bf1c313c17da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:42.623064 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c9d8a847-65fb-43d3-bcd2-bf1c313c17da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:42.630136 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c9d8a847-65fb-43d3-bcd2-bf1c313c17da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:42.639466 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c9d8a847-65fb-43d3-bcd2-bf1c313c17da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:42.640599 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c9d8a847-65fb-43d3-bcd2-bf1c313c17da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:42.641174 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c9d8a847-65fb-43d3-bcd2-bf1c313c17da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:42.704706 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-9fd1f07f-1d18-48a4-aba9-14ae47d23335 req-552f2d9d-29ef-4c39-832a-747f515b0120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29badaf3-597c-4a1e-ba08-008aa9774486", "name": "network-vif-deleted", "tag": "874822ac-b13b-4f2e-8208-788759ce1f69"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:43:42.715495 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-9fd1f07f-1d18-48a4-aba9-14ae47d23335 req-552f2d9d-29ef-4c39-832a-747f515b0120 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:42.715953 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-9fd1f07f-1d18-48a4-aba9-14ae47d23335 req-552f2d9d-29ef-4c39-832a-747f515b0120 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:42.718877 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:42.729891 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-9fd1f07f-1d18-48a4-aba9-14ae47d23335 req-552f2d9d-29ef-4c39-832a-747f515b0120 service nova] Creating event network-vif-deleted:874822ac-b13b-4f2e-8208-788759ce1f69 for instance 29badaf3-597c-4a1e-ba08-008aa9774486 on hv-cinder-84580 Jun 14 19:43:42.735089 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-9fd1f07f-1d18-48a4-aba9-14ae47d23335 req-552f2d9d-29ef-4c39-832a-747f515b0120 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034188 Jun 14 19:43:42.735730 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 125/257] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:43:42.796296 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c9d8a847-65fb-43d3-bcd2-bf1c313c17da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:42.803863 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c9d8a847-65fb-43d3-bcd2-bf1c313c17da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.186242 Jun 14 19:43:42.804467 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 133/258] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:42 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:43:43.464669 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ea3a3b05-0817-4504-beea-1e09997a701c tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:43.465270 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ea3a3b05-0817-4504-beea-1e09997a701c tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] [instance: 29badaf3-597c-4a1e-ba08-008aa9774486] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:43.472324 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ea3a3b05-0817-4504-beea-1e09997a701c tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:43.472814 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ea3a3b05-0817-4504-beea-1e09997a701c tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:43.473608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ea3a3b05-0817-4504-beea-1e09997a701c tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:43.474039 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ea3a3b05-0817-4504-beea-1e09997a701c tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:43.488369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-ea3a3b05-0817-4504-beea-1e09997a701c tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] HTTP exception thrown: Instance 29badaf3-597c-4a1e-ba08-008aa9774486 could not be found. Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ea3a3b05-0817-4504-beea-1e09997a701c tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Request method failure captured: Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 HTTP/1.1 Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOTGjxi2w9_8a9TSustwDoN1a7HvNBwPcmnO26WUJBS1VAscahP62Lq4jDEMvCTgJ13LIHFKaTRsEtx1XdIfjnJwuNgyWm4iPs7U8qGzW5wLVOVJ2HD7MfB4t0XGLq7QCizNSo_37ZM_CzKNT5h6FRahn8o4DNmEKfdcJ0l86p_1YGc Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: cbf704ce7bfd49f5b83ca2e7e0120c91 Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-VolumesActionsTest-1854470073 Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:43:43.490389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:43:43.492573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbf704ce7bfd49f5b83ca2e7e0120c91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cbf704ce7bfd49f5b83ca2e7e0120c91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cbf704ce7bfd49f5b83ca2e7e0120c91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbf704ce7bfd49f5b83ca2e7e0120c91"}]}] Jun 14 19:43:43.492573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-VolumesActionsTest-1854470073 Jun 14 19:43:43.492573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: cbf704ce7bfd49f5b83ca2e7e0120c91 Jun 14 19:43:43.492573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-VolumesActionsTest-1854470073 Jun 14 19:43:43.492573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-VolumesActionsTest-1854470073-project Jun 14 19:43:43.492573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:43:43.492573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:43:43.492573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: de843beff4dd401fb34b34ab83f6f7f3 Jun 14 19:43:43.492573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-VolumesActionsTest-1854470073-project Jun 14 19:43:43.492573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:43:43.492573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance 29badaf3-597c-4a1e-ba08-008aa9774486 could not be found. Jun 14 19:43:43.492573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '29badaf3-597c-4a1e-ba08-008aa9774486'} Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29badaf3-597c-4a1e-ba08-008aa9774486 could not be found. Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:43:43.493336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29badaf3-597c-4a1e-ba08-008aa9774486 could not be found. Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29badaf3-597c-4a1e-ba08-008aa9774486 could not be found. Jun 14 19:43:43.494816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:43:43.495959 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ea3a3b05-0817-4504-beea-1e09997a701c tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] Returning 404 to user: Instance 29badaf3-597c-4a1e-ba08-008aa9774486 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:43:43.495959 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-ea3a3b05-0817-4504-beea-1e09997a701c tempest-VolumesActionsTest-1854470073 tempest-VolumesActionsTest-1854470073-project] 10.222.0.44 "GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486" status: 404 len: 111 microversion: 2.1 time: 0.033665 Jun 14 19:43:43.495959 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 126/259] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:43 2022] GET /compute/v2.1/servers/29badaf3-597c-4a1e-ba08-008aa9774486 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:43:43.823821 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-8ab96879-3c09-48b0-b84a-b56426ae5f4a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:43.824539 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8ab96879-3c09-48b0-b84a-b56426ae5f4a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:43.831279 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8ab96879-3c09-48b0-b84a-b56426ae5f4a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:43.831726 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8ab96879-3c09-48b0-b84a-b56426ae5f4a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:43.832524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8ab96879-3c09-48b0-b84a-b56426ae5f4a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:43.832958 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8ab96879-3c09-48b0-b84a-b56426ae5f4a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:43.975553 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-8ab96879-3c09-48b0-b84a-b56426ae5f4a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:43.978516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:43.986050 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-8ab96879-3c09-48b0-b84a-b56426ae5f4a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.168248 Jun 14 19:43:43.986621 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 134/260] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:43 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:44.860345 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ede3f8fb-60ed-47d7-bd6d-b459d10da82d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:44.860920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ede3f8fb-60ed-47d7-bd6d-b459d10da82d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:44.868416 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ede3f8fb-60ed-47d7-bd6d-b459d10da82d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:44.868858 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ede3f8fb-60ed-47d7-bd6d-b459d10da82d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:44.869666 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ede3f8fb-60ed-47d7-bd6d-b459d10da82d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:44.870098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ede3f8fb-60ed-47d7-bd6d-b459d10da82d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:44.896217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-ede3f8fb-60ed-47d7-bd6d-b459d10da82d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/ips" status: 200 len: 150 microversion: 2.20 time: 0.039779 Jun 14 19:43:44.896787 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 127/261] 10.222.0.44 () {60 vars in 1288 bytes} [Tue Jun 14 19:43:44 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 19:43:45.009756 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c2ddc7ae-71c0-4c53-843d-14200029f00c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:45.011670 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c2ddc7ae-71c0-4c53-843d-14200029f00c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:45.022117 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c2ddc7ae-71c0-4c53-843d-14200029f00c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:45.023771 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c2ddc7ae-71c0-4c53-843d-14200029f00c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:45.025308 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c2ddc7ae-71c0-4c53-843d-14200029f00c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:45.026052 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c2ddc7ae-71c0-4c53-843d-14200029f00c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:45.184649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c2ddc7ae-71c0-4c53-843d-14200029f00c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:45.192436 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c2ddc7ae-71c0-4c53-843d-14200029f00c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.191643 Jun 14 19:43:45.201455 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 135/262] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:44 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:46.210137 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9c93d28c-516b-4bbd-b521-10acbf054318 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:46.211258 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9c93d28c-516b-4bbd-b521-10acbf054318 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:46.213696 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:46.219176 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9c93d28c-516b-4bbd-b521-10acbf054318 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:46.219621 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9c93d28c-516b-4bbd-b521-10acbf054318 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:46.220374 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9c93d28c-516b-4bbd-b521-10acbf054318 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:46.220807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9c93d28c-516b-4bbd-b521-10acbf054318 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:46.352252 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9c93d28c-516b-4bbd-b521-10acbf054318 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:46.359665 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9c93d28c-516b-4bbd-b521-10acbf054318 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.153470 Jun 14 19:43:46.360219 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 128/263] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:46 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:47.376936 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-8e7f3418-d32d-4e6c-98f6-66022751d820 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:47.377516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8e7f3418-d32d-4e6c-98f6-66022751d820 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:47.384352 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8e7f3418-d32d-4e6c-98f6-66022751d820 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:47.384798 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8e7f3418-d32d-4e6c-98f6-66022751d820 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:47.385586 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8e7f3418-d32d-4e6c-98f6-66022751d820 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:47.386019 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8e7f3418-d32d-4e6c-98f6-66022751d820 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:47.513632 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-8e7f3418-d32d-4e6c-98f6-66022751d820 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:47.520992 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-8e7f3418-d32d-4e6c-98f6-66022751d820 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.147885 Jun 14 19:43:47.521589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 136/264] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:47 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:48.195130 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9c712481-543c-4e82-a172-394a79ad496e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:48.195769 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9c712481-543c-4e82-a172-394a79ad496e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:48.202258 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9c712481-543c-4e82-a172-394a79ad496e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:48.202709 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9c712481-543c-4e82-a172-394a79ad496e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:48.203504 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9c712481-543c-4e82-a172-394a79ad496e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:48.204031 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9c712481-543c-4e82-a172-394a79ad496e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:48.228591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9c712481-543c-4e82-a172-394a79ad496e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/ips" status: 200 len: 146 microversion: 2.1 time: 0.037100 Jun 14 19:43:48.229158 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 129/265] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 14 19:43:48 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:43:48.319480 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-42ca4ca9-c662-4cd1-808f-e90bef232a65 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:48.321352 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-42ca4ca9-c662-4cd1-808f-e90bef232a65 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:48.326997 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-42ca4ca9-c662-4cd1-808f-e90bef232a65 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:48.327540 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-42ca4ca9-c662-4cd1-808f-e90bef232a65 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:48.328437 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-42ca4ca9-c662-4cd1-808f-e90bef232a65 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:48.328933 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-42ca4ca9-c662-4cd1-808f-e90bef232a65 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:48.358115 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-42ca4ca9-c662-4cd1-808f-e90bef232a65 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084/ips" status: 200 len: 148 microversion: 2.1 time: 0.042673 Jun 14 19:43:48.358872 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 137/266] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 14 19:43:48 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084/ips => generated 148 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:43:48.539870 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-cf9c0500-0a08-4fad-8d34-27ef1de4a3bf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:48.540665 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-cf9c0500-0a08-4fad-8d34-27ef1de4a3bf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:48.548112 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cf9c0500-0a08-4fad-8d34-27ef1de4a3bf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:48.548623 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cf9c0500-0a08-4fad-8d34-27ef1de4a3bf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:48.550066 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cf9c0500-0a08-4fad-8d34-27ef1de4a3bf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:48.550066 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cf9c0500-0a08-4fad-8d34-27ef1de4a3bf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:48.729347 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-cf9c0500-0a08-4fad-8d34-27ef1de4a3bf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:48.739669 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-cf9c0500-0a08-4fad-8d34-27ef1de4a3bf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.204937 Jun 14 19:43:48.740614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 130/267] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:48 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:49.392115 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b22dfe31-82ae-40a6-855d-0ab1c4b6d4e4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:43:49.392859 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b22dfe31-82ae-40a6-855d-0ab1c4b6d4e4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:49.403720 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b22dfe31-82ae-40a6-855d-0ab1c4b6d4e4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:49.404834 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b22dfe31-82ae-40a6-855d-0ab1c4b6d4e4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:49.407048 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b22dfe31-82ae-40a6-855d-0ab1c4b6d4e4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:49.408280 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b22dfe31-82ae-40a6-855d-0ab1c4b6d4e4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:49.444303 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.objects.instance [None req-b22dfe31-82ae-40a6-855d-0ab1c4b6d4e4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lazy-loading 'flavor' on Instance uuid 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 {{(pid=124068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:43:49.759616 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-edf63e3f-2be4-4ef5-9f05-788675ca9007 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:49.760266 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-edf63e3f-2be4-4ef5-9f05-788675ca9007 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:49.767092 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-edf63e3f-2be4-4ef5-9f05-788675ca9007 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:49.767648 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-edf63e3f-2be4-4ef5-9f05-788675ca9007 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:49.768302 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-edf63e3f-2be4-4ef5-9f05-788675ca9007 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:49.768786 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-edf63e3f-2be4-4ef5-9f05-788675ca9007 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:49.942806 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-edf63e3f-2be4-4ef5-9f05-788675ca9007 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:50.037828 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-edf63e3f-2be4-4ef5-9f05-788675ca9007 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.283360 Jun 14 19:43:50.038844 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 131/268] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:49 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:50.044247 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-cbdb7af2-ff4b-4717-a80a-1b0b22d69ffc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09e61fce-e4b1-4ce3-9bd5-7528fa8b7f5b"}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:43:50.046611 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-cbdb7af2-ff4b-4717-a80a-1b0b22d69ffc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:50.053834 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cbdb7af2-ff4b-4717-a80a-1b0b22d69ffc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:50.054541 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cbdb7af2-ff4b-4717-a80a-1b0b22d69ffc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:50.056520 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cbdb7af2-ff4b-4717-a80a-1b0b22d69ffc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:50.057103 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cbdb7af2-ff4b-4717-a80a-1b0b22d69ffc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:50.095932 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b22dfe31-82ae-40a6-855d-0ab1c4b6d4e4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "POST /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/action" status: 202 len: 0 microversion: 2.20 time: 0.707950 Jun 14 19:43:50.104731 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 138/269] 10.222.0.44 () {62 vars in 1318 bytes} [Tue Jun 14 19:43:49 2022] POST /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/action => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:43:50.115265 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b58be517-f347-4796-b995-5a659fd938be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:50.116528 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b58be517-f347-4796-b995-5a659fd938be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:50.124709 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b58be517-f347-4796-b995-5a659fd938be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:50.125253 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b58be517-f347-4796-b995-5a659fd938be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:50.126077 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b58be517-f347-4796-b995-5a659fd938be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:50.126752 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b58be517-f347-4796-b995-5a659fd938be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:50.557496 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b58be517-f347-4796-b995-5a659fd938be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:50.567600 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b58be517-f347-4796-b995-5a659fd938be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:50.569103 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b58be517-f347-4796-b995-5a659fd938be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:50.570772 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b58be517-f347-4796-b995-5a659fd938be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.464789 Jun 14 19:43:50.571338 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 139/270] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:43:50 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:43:50.696415 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-cbdb7af2-ff4b-4717-a80a-1b0b22d69ffc tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "POST /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.655123 Jun 14 19:43:50.706148 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 132/271] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 14 19:43:50 2022] POST /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084/os-volume_attachments => generated 194 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:43:51.056596 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-6fb234f4-fd94-4907-9358-46c32b4e851a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:51.057272 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-6fb234f4-fd94-4907-9358-46c32b4e851a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:51.059419 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:51.069725 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6fb234f4-fd94-4907-9358-46c32b4e851a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:51.070609 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6fb234f4-fd94-4907-9358-46c32b4e851a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:51.071712 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6fb234f4-fd94-4907-9358-46c32b4e851a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:51.072372 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6fb234f4-fd94-4907-9358-46c32b4e851a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:51.246429 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-6fb234f4-fd94-4907-9358-46c32b4e851a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:51.260654 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-6fb234f4-fd94-4907-9358-46c32b4e851a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.208748 Jun 14 19:43:51.263461 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 140/272] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:51 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:51.591033 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-20b189fe-5f35-4ca2-af72-cd23c6b53470 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:51.592351 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-20b189fe-5f35-4ca2-af72-cd23c6b53470 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:51.599590 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-20b189fe-5f35-4ca2-af72-cd23c6b53470 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:51.600045 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-20b189fe-5f35-4ca2-af72-cd23c6b53470 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:51.600814 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-20b189fe-5f35-4ca2-af72-cd23c6b53470 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:51.601279 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-20b189fe-5f35-4ca2-af72-cd23c6b53470 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:51.750134 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-20b189fe-5f35-4ca2-af72-cd23c6b53470 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:51.760646 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-20b189fe-5f35-4ca2-af72-cd23c6b53470 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:51.762269 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-20b189fe-5f35-4ca2-af72-cd23c6b53470 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:51.763505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-20b189fe-5f35-4ca2-af72-cd23c6b53470 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.177504 Jun 14 19:43:51.764137 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 133/273] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:43:51 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:43:52.282314 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b3bf0a13-8da5-46b0-a8e7-694a0485e5d9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:52.283097 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b3bf0a13-8da5-46b0-a8e7-694a0485e5d9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:52.290614 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b3bf0a13-8da5-46b0-a8e7-694a0485e5d9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:52.291199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b3bf0a13-8da5-46b0-a8e7-694a0485e5d9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:52.292025 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b3bf0a13-8da5-46b0-a8e7-694a0485e5d9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:52.292585 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b3bf0a13-8da5-46b0-a8e7-694a0485e5d9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:52.453785 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b3bf0a13-8da5-46b0-a8e7-694a0485e5d9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:52.462231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b3bf0a13-8da5-46b0-a8e7-694a0485e5d9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.184359 Jun 14 19:43:52.463058 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 141/274] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:52 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:52.598743 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1a71d9fa-137e-4953-b139-6f1984370080 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71d631b7-5e83-4360-9b95-e7b2e15ce0c0"}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:43:52.600008 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-1a71d9fa-137e-4953-b139-6f1984370080 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:52.608774 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1a71d9fa-137e-4953-b139-6f1984370080 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:52.609225 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1a71d9fa-137e-4953-b139-6f1984370080 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:52.610106 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1a71d9fa-137e-4953-b139-6f1984370080 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:52.610676 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1a71d9fa-137e-4953-b139-6f1984370080 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:52.783738 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e9182004-c4db-4037-ad49-a4720a50cd11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:52.784784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e9182004-c4db-4037-ad49-a4720a50cd11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:52.794575 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e9182004-c4db-4037-ad49-a4720a50cd11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:52.795347 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e9182004-c4db-4037-ad49-a4720a50cd11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:52.796706 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e9182004-c4db-4037-ad49-a4720a50cd11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:52.797269 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e9182004-c4db-4037-ad49-a4720a50cd11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:52.947011 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-1a71d9fa-137e-4953-b139-6f1984370080 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "POST /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345616 Jun 14 19:43:52.947011 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 134/275] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 14 19:43:52 2022] POST /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:43:53.038409 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-e9182004-c4db-4037-ad49-a4720a50cd11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:53.057543 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-e9182004-c4db-4037-ad49-a4720a50cd11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:53.061416 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-e9182004-c4db-4037-ad49-a4720a50cd11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:53.062832 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e9182004-c4db-4037-ad49-a4720a50cd11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.284295 Jun 14 19:43:53.065684 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 142/276] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:43:52 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:43:53.481859 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8dab84e2-f79e-4204-a564-258a548ecfac tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:53.483053 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8dab84e2-f79e-4204-a564-258a548ecfac tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:53.489538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8dab84e2-f79e-4204-a564-258a548ecfac tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:53.490015 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8dab84e2-f79e-4204-a564-258a548ecfac tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:53.490783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8dab84e2-f79e-4204-a564-258a548ecfac tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:53.491228 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8dab84e2-f79e-4204-a564-258a548ecfac tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:53.656600 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8dab84e2-f79e-4204-a564-258a548ecfac tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:53.666846 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8dab84e2-f79e-4204-a564-258a548ecfac tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.190505 Jun 14 19:43:53.667420 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 135/277] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:53 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:54.086209 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-84c68c9b-80d6-4006-b0a7-9703bd6b3bd3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:54.088336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-84c68c9b-80d6-4006-b0a7-9703bd6b3bd3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:54.103066 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-84c68c9b-80d6-4006-b0a7-9703bd6b3bd3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:54.104165 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-84c68c9b-80d6-4006-b0a7-9703bd6b3bd3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:54.105573 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-84c68c9b-80d6-4006-b0a7-9703bd6b3bd3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:54.108290 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-84c68c9b-80d6-4006-b0a7-9703bd6b3bd3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:54.274850 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-84c68c9b-80d6-4006-b0a7-9703bd6b3bd3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:54.283765 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-84c68c9b-80d6-4006-b0a7-9703bd6b3bd3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:54.285361 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-84c68c9b-80d6-4006-b0a7-9703bd6b3bd3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:54.286699 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-84c68c9b-80d6-4006-b0a7-9703bd6b3bd3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.206325 Jun 14 19:43:54.287253 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 143/278] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:43:54 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:43:54.685647 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c12b493b-9453-43cd-957b-27925ede6456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:54.686387 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c12b493b-9453-43cd-957b-27925ede6456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:54.696550 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c12b493b-9453-43cd-957b-27925ede6456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:54.697234 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c12b493b-9453-43cd-957b-27925ede6456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:54.698573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c12b493b-9453-43cd-957b-27925ede6456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:54.699084 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c12b493b-9453-43cd-957b-27925ede6456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:54.832162 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c12b493b-9453-43cd-957b-27925ede6456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:54.841089 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c12b493b-9453-43cd-957b-27925ede6456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.160831 Jun 14 19:43:54.841778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 136/279] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:54 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:55.308131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-290d73bf-7854-451d-a9e7-342f6c82dcbc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:55.308907 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-290d73bf-7854-451d-a9e7-342f6c82dcbc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:55.315846 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-290d73bf-7854-451d-a9e7-342f6c82dcbc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:55.316522 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-290d73bf-7854-451d-a9e7-342f6c82dcbc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:55.317253 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-290d73bf-7854-451d-a9e7-342f6c82dcbc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:55.317908 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-290d73bf-7854-451d-a9e7-342f6c82dcbc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:55.485582 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-290d73bf-7854-451d-a9e7-342f6c82dcbc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:55.495127 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-290d73bf-7854-451d-a9e7-342f6c82dcbc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:55.496857 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-290d73bf-7854-451d-a9e7-342f6c82dcbc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:55.498068 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-290d73bf-7854-451d-a9e7-342f6c82dcbc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.195495 Jun 14 19:43:55.499812 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 144/280] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:43:55 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:43:55.858568 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1b5ccd1b-7536-41a7-a58c-cc7bc4040e7a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:55.860050 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-1b5ccd1b-7536-41a7-a58c-cc7bc4040e7a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:55.879239 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1b5ccd1b-7536-41a7-a58c-cc7bc4040e7a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:55.885707 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1b5ccd1b-7536-41a7-a58c-cc7bc4040e7a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:55.886813 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1b5ccd1b-7536-41a7-a58c-cc7bc4040e7a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:55.887870 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1b5ccd1b-7536-41a7-a58c-cc7bc4040e7a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:56.094751 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-1b5ccd1b-7536-41a7-a58c-cc7bc4040e7a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:56.105477 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-1b5ccd1b-7536-41a7-a58c-cc7bc4040e7a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.250804 Jun 14 19:43:56.106480 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 137/281] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:55 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:56.519106 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-77e185ca-d752-4dc8-877e-713f2d8b3e9a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:56.519714 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-77e185ca-d752-4dc8-877e-713f2d8b3e9a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:56.526544 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-77e185ca-d752-4dc8-877e-713f2d8b3e9a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:56.526996 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-77e185ca-d752-4dc8-877e-713f2d8b3e9a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:56.527762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-77e185ca-d752-4dc8-877e-713f2d8b3e9a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:56.528195 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-77e185ca-d752-4dc8-877e-713f2d8b3e9a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:56.681164 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-77e185ca-d752-4dc8-877e-713f2d8b3e9a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:56.690020 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-77e185ca-d752-4dc8-877e-713f2d8b3e9a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:56.691556 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-77e185ca-d752-4dc8-877e-713f2d8b3e9a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:56.692752 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-77e185ca-d752-4dc8-877e-713f2d8b3e9a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.177553 Jun 14 19:43:56.693674 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 145/282] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:43:56 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:43:57.124194 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-7a761734-34dd-4066-9504-26d9983fa9cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:57.125009 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-7a761734-34dd-4066-9504-26d9983fa9cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:57.132046 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7a761734-34dd-4066-9504-26d9983fa9cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:57.132497 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7a761734-34dd-4066-9504-26d9983fa9cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:57.133398 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7a761734-34dd-4066-9504-26d9983fa9cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:57.133860 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7a761734-34dd-4066-9504-26d9983fa9cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:57.296646 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-7a761734-34dd-4066-9504-26d9983fa9cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:57.304326 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-7a761734-34dd-4066-9504-26d9983fa9cb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.184098 Jun 14 19:43:57.305071 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 138/283] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:57 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:43:57.715256 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-ea0334ea-e8d2-420d-816c-543e299f6f5a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:57.715892 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-ea0334ea-e8d2-420d-816c-543e299f6f5a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:57.724403 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ea0334ea-e8d2-420d-816c-543e299f6f5a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:57.725041 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ea0334ea-e8d2-420d-816c-543e299f6f5a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:57.726105 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ea0334ea-e8d2-420d-816c-543e299f6f5a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:57.726864 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ea0334ea-e8d2-420d-816c-543e299f6f5a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:57.927941 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ea0334ea-e8d2-420d-816c-543e299f6f5a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:57.942487 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ea0334ea-e8d2-420d-816c-543e299f6f5a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:57.944563 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ea0334ea-e8d2-420d-816c-543e299f6f5a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:57.947206 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-ea0334ea-e8d2-420d-816c-543e299f6f5a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.237927 Jun 14 19:43:57.948129 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 146/284] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:43:57 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:43:58.322347 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4bdab636-361f-48c4-af71-9d8c98efb1ea tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:58.323141 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4bdab636-361f-48c4-af71-9d8c98efb1ea tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:58.329785 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4bdab636-361f-48c4-af71-9d8c98efb1ea tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:58.330471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4bdab636-361f-48c4-af71-9d8c98efb1ea tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:58.331249 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4bdab636-361f-48c4-af71-9d8c98efb1ea tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:58.331841 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4bdab636-361f-48c4-af71-9d8c98efb1ea tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:58.394736 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3d1cff31-95e1-44a2-a3c9-fe194c2bf88d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Action: 'create', calling method: .version_select at 0x7f144afacca0>, body: {"keypair": {"name": "tempest-keypair-1602562430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArfNy9Loz5XFkrRbjvre7V3KzFxQVvBwpbYth2yJLnhXrBSmkY9jV7Fu4bDkK2kDixiLJmItkKdEIVaoL8odjoczhGKVr6XSvt8Ozsy0G653ywvuBL1FR6ndd3+m0pzeQ=="}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:43:58.426535 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-3d1cff31-95e1-44a2-a3c9-fe194c2bf88d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:43:58.436033 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-3d1cff31-95e1-44a2-a3c9-fe194c2bf88d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for user 323c51f037db4ecca2f66cb6e9879246 and project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:43:58.495915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3d1cff31-95e1-44a2-a3c9-fe194c2bf88d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104821 Jun 14 19:43:58.498588 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 147/285] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 14 19:43:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:43:58.545484 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4bdab636-361f-48c4-af71-9d8c98efb1ea tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:58.563915 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4bdab636-361f-48c4-af71-9d8c98efb1ea tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.238995 Jun 14 19:43:58.565841 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 139/286] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:58 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:43:58.970436 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a4c02d7a-2704-431c-be7f-c17b4994f1e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:58.971264 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a4c02d7a-2704-431c-be7f-c17b4994f1e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:58.978547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a4c02d7a-2704-431c-be7f-c17b4994f1e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:58.979629 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a4c02d7a-2704-431c-be7f-c17b4994f1e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:58.981518 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a4c02d7a-2704-431c-be7f-c17b4994f1e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:58.982377 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a4c02d7a-2704-431c-be7f-c17b4994f1e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:59.214617 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a4c02d7a-2704-431c-be7f-c17b4994f1e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:59.227727 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a4c02d7a-2704-431c-be7f-c17b4994f1e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:59.229640 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a4c02d7a-2704-431c-be7f-c17b4994f1e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:59.231044 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a4c02d7a-2704-431c-be7f-c17b4994f1e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.267553 Jun 14 19:43:59.241969 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 148/287] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:43:58 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:43:59.583661 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-148e4be8-3679-42cf-8e1d-e0ec2957c7c5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:43:59.584611 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-148e4be8-3679-42cf-8e1d-e0ec2957c7c5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:43:59.594291 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-148e4be8-3679-42cf-8e1d-e0ec2957c7c5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:59.595007 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-148e4be8-3679-42cf-8e1d-e0ec2957c7c5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:59.596924 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-148e4be8-3679-42cf-8e1d-e0ec2957c7c5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:43:59.597584 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-148e4be8-3679-42cf-8e1d-e0ec2957c7c5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:43:59.897791 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-148e4be8-3679-42cf-8e1d-e0ec2957c7c5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:43:59.909826 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-148e4be8-3679-42cf-8e1d-e0ec2957c7c5 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.330904 Jun 14 19:43:59.910705 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 140/288] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:43:59 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:00.254206 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4a1923a5-c67c-44d7-8ac3-11cac3412693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:00.255508 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4a1923a5-c67c-44d7-8ac3-11cac3412693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:00.267907 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4a1923a5-c67c-44d7-8ac3-11cac3412693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:00.269604 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4a1923a5-c67c-44d7-8ac3-11cac3412693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:00.270874 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4a1923a5-c67c-44d7-8ac3-11cac3412693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:00.271499 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4a1923a5-c67c-44d7-8ac3-11cac3412693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:00.381699 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1944150899", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "810afb1c-546b-4676-b2eb-077f19735ed6"}], "security_groups": [{"name": "tempest-securitygroup--1863749852"}], "key_name": "tempest-keypair-1602562430", "user_data": "}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:00.419186 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4a1923a5-c67c-44d7-8ac3-11cac3412693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:00.428457 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4a1923a5-c67c-44d7-8ac3-11cac3412693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:00.432160 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4a1923a5-c67c-44d7-8ac3-11cac3412693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:00.433445 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4a1923a5-c67c-44d7-8ac3-11cac3412693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.183760 Jun 14 19:44:00.434208 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 149/289] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:00 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:44:00.928065 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-61ae1806-79b4-4543-b6ab-41f5a2d2d32f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:00.929019 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-61ae1806-79b4-4543-b6ab-41f5a2d2d32f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:00.935740 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-61ae1806-79b4-4543-b6ab-41f5a2d2d32f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:00.936274 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-61ae1806-79b4-4543-b6ab-41f5a2d2d32f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:00.937127 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-61ae1806-79b4-4543-b6ab-41f5a2d2d32f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:00.937789 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-61ae1806-79b4-4543-b6ab-41f5a2d2d32f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:01.152705 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-61ae1806-79b4-4543-b6ab-41f5a2d2d32f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:01.155476 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:01.165014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-61ae1806-79b4-4543-b6ab-41f5a2d2d32f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.241370 Jun 14 19:44:01.165774 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 150/290] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:00 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:01.452314 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d6b9c1e0-000f-4a9d-8288-3fe3c86169af tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:01.453233 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d6b9c1e0-000f-4a9d-8288-3fe3c86169af tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:01.463986 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d6b9c1e0-000f-4a9d-8288-3fe3c86169af tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:01.464743 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d6b9c1e0-000f-4a9d-8288-3fe3c86169af tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:01.465687 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d6b9c1e0-000f-4a9d-8288-3fe3c86169af tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:01.466214 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d6b9c1e0-000f-4a9d-8288-3fe3c86169af tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:01.618060 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d6b9c1e0-000f-4a9d-8288-3fe3c86169af tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:01.626250 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d6b9c1e0-000f-4a9d-8288-3fe3c86169af tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:01.627984 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d6b9c1e0-000f-4a9d-8288-3fe3c86169af tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:01.629160 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d6b9c1e0-000f-4a9d-8288-3fe3c86169af tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.180755 Jun 14 19:44:01.629739 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 151/291] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:01 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:44:02.184009 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e2226d1b-98e3-43a2-b74d-d2265ebc79df tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:02.184969 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e2226d1b-98e3-43a2-b74d-d2265ebc79df tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:02.190978 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e2226d1b-98e3-43a2-b74d-d2265ebc79df tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:02.191430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e2226d1b-98e3-43a2-b74d-d2265ebc79df tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:02.192186 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e2226d1b-98e3-43a2-b74d-d2265ebc79df tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:02.192777 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e2226d1b-98e3-43a2-b74d-d2265ebc79df tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:02.349058 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-e2226d1b-98e3-43a2-b74d-d2265ebc79df tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:02.357573 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e2226d1b-98e3-43a2-b74d-d2265ebc79df tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.177949 Jun 14 19:44:02.358172 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 152/292] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:02 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:02.651286 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0524a0b4-2ac3-466a-9086-9344afeef87e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:02.652024 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-0524a0b4-2ac3-466a-9086-9344afeef87e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:02.658378 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0524a0b4-2ac3-466a-9086-9344afeef87e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:02.658818 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0524a0b4-2ac3-466a-9086-9344afeef87e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:02.659568 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0524a0b4-2ac3-466a-9086-9344afeef87e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:02.659991 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0524a0b4-2ac3-466a-9086-9344afeef87e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:02.852552 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0524a0b4-2ac3-466a-9086-9344afeef87e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:02.860738 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0524a0b4-2ac3-466a-9086-9344afeef87e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:02.862277 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0524a0b4-2ac3-466a-9086-9344afeef87e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:02.863417 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-0524a0b4-2ac3-466a-9086-9344afeef87e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.217359 Jun 14 19:44:02.863957 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 153/293] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:02 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:03.374892 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4557fcdb-d2d6-43d8-af71-4edcbaba3fb7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:03.375675 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4557fcdb-d2d6-43d8-af71-4edcbaba3fb7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:03.381982 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4557fcdb-d2d6-43d8-af71-4edcbaba3fb7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:03.382530 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4557fcdb-d2d6-43d8-af71-4edcbaba3fb7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:03.384044 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4557fcdb-d2d6-43d8-af71-4edcbaba3fb7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:03.384485 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4557fcdb-d2d6-43d8-af71-4edcbaba3fb7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:03.543374 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4557fcdb-d2d6-43d8-af71-4edcbaba3fb7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:03.551390 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4557fcdb-d2d6-43d8-af71-4edcbaba3fb7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.180389 Jun 14 19:44:03.552267 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 154/294] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:03 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:03.882035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-fbbcf34c-4bc8-42a7-a4db-a4172243bb68 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:03.882706 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-fbbcf34c-4bc8-42a7-a4db-a4172243bb68 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:03.890073 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fbbcf34c-4bc8-42a7-a4db-a4172243bb68 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:03.890537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fbbcf34c-4bc8-42a7-a4db-a4172243bb68 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:03.891331 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fbbcf34c-4bc8-42a7-a4db-a4172243bb68 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:03.891852 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fbbcf34c-4bc8-42a7-a4db-a4172243bb68 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:04.051530 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-fbbcf34c-4bc8-42a7-a4db-a4172243bb68 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:04.060322 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-fbbcf34c-4bc8-42a7-a4db-a4172243bb68 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:04.061784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-fbbcf34c-4bc8-42a7-a4db-a4172243bb68 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:04.062940 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-fbbcf34c-4bc8-42a7-a4db-a4172243bb68 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.184799 Jun 14 19:44:04.063607 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 155/295] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:03 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:44:04.571851 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e9040706-ea84-4ced-8e93-426b25cdcb77 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:04.572929 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e9040706-ea84-4ced-8e93-426b25cdcb77 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:04.579608 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e9040706-ea84-4ced-8e93-426b25cdcb77 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:04.580061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e9040706-ea84-4ced-8e93-426b25cdcb77 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:04.580827 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e9040706-ea84-4ced-8e93-426b25cdcb77 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:04.581287 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e9040706-ea84-4ced-8e93-426b25cdcb77 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:04.727179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-e9040706-ea84-4ced-8e93-426b25cdcb77 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:04.735267 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e9040706-ea84-4ced-8e93-426b25cdcb77 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.168127 Jun 14 19:44:04.736257 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 156/296] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:04 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:05.058233 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-63ec3e13-d690-499b-b937-c56258cc482a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:05.065866 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-63ec3e13-d690-499b-b937-c56258cc482a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:05.066394 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-63ec3e13-d690-499b-b937-c56258cc482a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:05.139643 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-63ec3e13-d690-499b-b937-c56258cc482a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Going to try to stop instance {{(pid=124068) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 14 19:44:05.189935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-63ec3e13-d690-499b-b937-c56258cc482a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "POST /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/action" status: 202 len: 0 microversion: 2.1 time: 0.136824 Jun 14 19:44:05.191037 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 157/297] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 14 19:44:05 2022] POST /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 19:44:05.199404 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-8febd803-b40e-4a53-9306-3d360d4b1f96 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:05.200051 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8febd803-b40e-4a53-9306-3d360d4b1f96 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:05.206429 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8febd803-b40e-4a53-9306-3d360d4b1f96 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:05.206868 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8febd803-b40e-4a53-9306-3d360d4b1f96 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:05.207622 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8febd803-b40e-4a53-9306-3d360d4b1f96 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:05.208048 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8febd803-b40e-4a53-9306-3d360d4b1f96 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:05.372521 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-8febd803-b40e-4a53-9306-3d360d4b1f96 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:05.380678 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-8febd803-b40e-4a53-9306-3d360d4b1f96 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:05.382211 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-8febd803-b40e-4a53-9306-3d360d4b1f96 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:05.384402 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-8febd803-b40e-4a53-9306-3d360d4b1f96 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.191865 Jun 14 19:44:05.394760 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 158/298] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:05 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:05.399679 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-78031e90-6def-4c46-88aa-ec3ca00be06a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:05.400296 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-78031e90-6def-4c46-88aa-ec3ca00be06a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:05.406562 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-78031e90-6def-4c46-88aa-ec3ca00be06a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:05.407000 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-78031e90-6def-4c46-88aa-ec3ca00be06a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:05.407758 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-78031e90-6def-4c46-88aa-ec3ca00be06a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:05.408200 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-78031e90-6def-4c46-88aa-ec3ca00be06a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:05.554415 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-78031e90-6def-4c46-88aa-ec3ca00be06a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:05.566379 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-78031e90-6def-4c46-88aa-ec3ca00be06a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1723 microversion: 2.1 time: 0.170287 Jun 14 19:44:05.567063 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 159/299] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:05 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:05.755275 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-87937033-149e-4c1c-ad00-cba86b5acedb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:05.755876 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-87937033-149e-4c1c-ad00-cba86b5acedb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:05.763928 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-87937033-149e-4c1c-ad00-cba86b5acedb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:05.764376 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-87937033-149e-4c1c-ad00-cba86b5acedb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:05.765152 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-87937033-149e-4c1c-ad00-cba86b5acedb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:05.765706 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-87937033-149e-4c1c-ad00-cba86b5acedb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:05.900897 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-87937033-149e-4c1c-ad00-cba86b5acedb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:05.909852 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-87937033-149e-4c1c-ad00-cba86b5acedb tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.158384 Jun 14 19:44:05.910558 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 160/300] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:05 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:06.402044 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c795012f-4fd0-4812-a969-0709382a7477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:06.402811 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c795012f-4fd0-4812-a969-0709382a7477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:06.409333 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c795012f-4fd0-4812-a969-0709382a7477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:06.409889 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c795012f-4fd0-4812-a969-0709382a7477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:06.410649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c795012f-4fd0-4812-a969-0709382a7477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:06.411106 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c795012f-4fd0-4812-a969-0709382a7477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:06.557056 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c795012f-4fd0-4812-a969-0709382a7477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:06.565208 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c795012f-4fd0-4812-a969-0709382a7477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:06.566725 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c795012f-4fd0-4812-a969-0709382a7477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:06.567995 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c795012f-4fd0-4812-a969-0709382a7477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.169976 Jun 14 19:44:06.568748 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 161/301] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:06 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:44:06.583692 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d6518763-84e7-445f-a666-f8115fb83c2c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:06.584302 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d6518763-84e7-445f-a666-f8115fb83c2c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:06.590917 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d6518763-84e7-445f-a666-f8115fb83c2c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:06.591439 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d6518763-84e7-445f-a666-f8115fb83c2c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:06.592268 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d6518763-84e7-445f-a666-f8115fb83c2c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:06.592703 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d6518763-84e7-445f-a666-f8115fb83c2c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:06.741781 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d6518763-84e7-445f-a666-f8115fb83c2c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:06.749944 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d6518763-84e7-445f-a666-f8115fb83c2c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1723 microversion: 2.1 time: 0.169956 Jun 14 19:44:06.750513 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 162/302] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:06 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:06.928417 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-6f55612d-9848-4434-a430-d732b111b2d0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:06.929013 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-6f55612d-9848-4434-a430-d732b111b2d0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:06.935670 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6f55612d-9848-4434-a430-d732b111b2d0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:06.936111 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6f55612d-9848-4434-a430-d732b111b2d0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:06.936867 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6f55612d-9848-4434-a430-d732b111b2d0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:06.937291 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6f55612d-9848-4434-a430-d732b111b2d0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:07.094275 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-6f55612d-9848-4434-a430-d732b111b2d0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:07.102717 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-6f55612d-9848-4434-a430-d732b111b2d0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.177933 Jun 14 19:44:07.103322 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 163/303] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:06 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:07.559185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.network.neutron [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] validate_networks() for [('810afb1c-546b-4676-b2eb-077f19735ed6', None, None, None, None, None)] {{(pid=124069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:44:07.590324 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-95b14fd9-5991-43c1-85aa-70eb0db71738 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:07.591116 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-95b14fd9-5991-43c1-85aa-70eb0db71738 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:07.599033 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-95b14fd9-5991-43c1-85aa-70eb0db71738 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:07.599599 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-95b14fd9-5991-43c1-85aa-70eb0db71738 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:07.600780 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-95b14fd9-5991-43c1-85aa-70eb0db71738 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:07.601543 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-95b14fd9-5991-43c1-85aa-70eb0db71738 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:07.764745 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-95b14fd9-5991-43c1-85aa-70eb0db71738 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:07.773701 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-95b14fd9-5991-43c1-85aa-70eb0db71738 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:07.775835 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-95b14fd9-5991-43c1-85aa-70eb0db71738 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:07.777088 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-95b14fd9-5991-43c1-85aa-70eb0db71738 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.194737 Jun 14 19:44:07.778039 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 164/304] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:07 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:07.782982 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-702de895-e7a6-4ea4-83c9-447077592d50 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:07.783657 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-702de895-e7a6-4ea4-83c9-447077592d50 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:07.790330 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-702de895-e7a6-4ea4-83c9-447077592d50 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:07.790863 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-702de895-e7a6-4ea4-83c9-447077592d50 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:07.791706 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-702de895-e7a6-4ea4-83c9-447077592d50 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:07.792277 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-702de895-e7a6-4ea4-83c9-447077592d50 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:07.936445 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-702de895-e7a6-4ea4-83c9-447077592d50 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:07.948762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-702de895-e7a6-4ea4-83c9-447077592d50 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1723 microversion: 2.1 time: 0.169566 Jun 14 19:44:07.949640 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 165/305] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:07 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:07.975518 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Flavor limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:44:07.975943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Image limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:44:07.976919 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Flavor pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:44:07.977325 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Image pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:44:07.977767 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:44:07.987709 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:07.988161 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:07.988965 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:07.989425 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:07.997241 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:08.013158 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:44:08.018034 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for user 323c51f037db4ecca2f66cb6e9879246 and project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:44:08.031027 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Going to run 1 instances... {{(pid=124069) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:44:08.033074 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:44:08.115971 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-086c3d10-8c42-411e-ba1b-b3143319fc56 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 7.738428 Jun 14 19:44:08.119925 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0b83458f-b3aa-4b92-81e8-e51ed1499db0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:08.120551 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-0b83458f-b3aa-4b92-81e8-e51ed1499db0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:08.125489 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 141/306] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:44:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 7749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 14 19:44:08.139315 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0b83458f-b3aa-4b92-81e8-e51ed1499db0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:08.139777 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0b83458f-b3aa-4b92-81e8-e51ed1499db0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:08.140570 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0b83458f-b3aa-4b92-81e8-e51ed1499db0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:08.140998 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0b83458f-b3aa-4b92-81e8-e51ed1499db0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:08.148409 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-25c3cf3f-e7d1-4634-a46f-fba11e2883f5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:08.149967 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-25c3cf3f-e7d1-4634-a46f-fba11e2883f5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:08.161826 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:08.264851 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-25c3cf3f-e7d1-4634-a46f-fba11e2883f5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:08.290316 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-25c3cf3f-e7d1-4634-a46f-fba11e2883f5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1242 microversion: 2.1 time: 0.159709 Jun 14 19:44:08.290937 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 142/307] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:08 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:08.333442 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0b83458f-b3aa-4b92-81e8-e51ed1499db0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:08.342310 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-0b83458f-b3aa-4b92-81e8-e51ed1499db0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.227183 Jun 14 19:44:08.345597 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 166/308] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:08 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:08.800869 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2d11e418-e397-480a-97fe-96dbc41a2a57 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:08.802580 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2d11e418-e397-480a-97fe-96dbc41a2a57 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:08.829728 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2d11e418-e397-480a-97fe-96dbc41a2a57 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:08.831749 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2d11e418-e397-480a-97fe-96dbc41a2a57 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:08.839573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2d11e418-e397-480a-97fe-96dbc41a2a57 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:08.843513 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2d11e418-e397-480a-97fe-96dbc41a2a57 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:08.966391 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a2031ff3-54a7-47bd-ae8e-dbf41ea34eb2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:08.967008 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a2031ff3-54a7-47bd-ae8e-dbf41ea34eb2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:08.969042 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=4 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:08.974336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2031ff3-54a7-47bd-ae8e-dbf41ea34eb2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:08.974790 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2031ff3-54a7-47bd-ae8e-dbf41ea34eb2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:08.975555 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2031ff3-54a7-47bd-ae8e-dbf41ea34eb2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:08.975992 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2031ff3-54a7-47bd-ae8e-dbf41ea34eb2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:09.040218 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2d11e418-e397-480a-97fe-96dbc41a2a57 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:09.048531 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2d11e418-e397-480a-97fe-96dbc41a2a57 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:09.050071 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2d11e418-e397-480a-97fe-96dbc41a2a57 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:09.051221 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2d11e418-e397-480a-97fe-96dbc41a2a57 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.255709 Jun 14 19:44:09.051779 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 143/309] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:08 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:09.120481 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a2031ff3-54a7-47bd-ae8e-dbf41ea34eb2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:09.137929 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a2031ff3-54a7-47bd-ae8e-dbf41ea34eb2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1723 microversion: 2.1 time: 0.175161 Jun 14 19:44:09.147240 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 167/310] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:08 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:09.308840 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-05a532b7-403a-4e8d-8580-df90d2b10808 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:09.309634 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-05a532b7-403a-4e8d-8580-df90d2b10808 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:09.316241 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-05a532b7-403a-4e8d-8580-df90d2b10808 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:09.316842 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-05a532b7-403a-4e8d-8580-df90d2b10808 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:09.317608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-05a532b7-403a-4e8d-8580-df90d2b10808 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:09.318060 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-05a532b7-403a-4e8d-8580-df90d2b10808 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:09.359782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-848a59cd-ff41-422b-9dc3-6e0710ad977c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:09.360612 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-848a59cd-ff41-422b-9dc3-6e0710ad977c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:09.375789 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-848a59cd-ff41-422b-9dc3-6e0710ad977c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:09.376576 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-848a59cd-ff41-422b-9dc3-6e0710ad977c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:09.382339 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-848a59cd-ff41-422b-9dc3-6e0710ad977c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:09.383676 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-848a59cd-ff41-422b-9dc3-6e0710ad977c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:09.385883 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-05a532b7-403a-4e8d-8580-df90d2b10808 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:09.394766 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-05a532b7-403a-4e8d-8580-df90d2b10808 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1294 microversion: 2.1 time: 0.090486 Jun 14 19:44:09.395761 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 144/311] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:09 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:09.591429 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-848a59cd-ff41-422b-9dc3-6e0710ad977c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:09.604724 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-848a59cd-ff41-422b-9dc3-6e0710ad977c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.248602 Jun 14 19:44:09.605690 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 168/312] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:09 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:10.069213 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-540421d0-42b0-4c9b-a0a8-9e1fd94266cb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:10.071098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-540421d0-42b0-4c9b-a0a8-9e1fd94266cb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:10.078319 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-540421d0-42b0-4c9b-a0a8-9e1fd94266cb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:10.078849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-540421d0-42b0-4c9b-a0a8-9e1fd94266cb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:10.079625 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-540421d0-42b0-4c9b-a0a8-9e1fd94266cb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:10.080062 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-540421d0-42b0-4c9b-a0a8-9e1fd94266cb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:10.158998 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-313c6461-636e-49f5-af26-13b0d455130d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:10.159629 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-313c6461-636e-49f5-af26-13b0d455130d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:10.191237 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-313c6461-636e-49f5-af26-13b0d455130d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:10.192750 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-313c6461-636e-49f5-af26-13b0d455130d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:10.196718 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-313c6461-636e-49f5-af26-13b0d455130d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:10.198362 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-313c6461-636e-49f5-af26-13b0d455130d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:10.230366 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-540421d0-42b0-4c9b-a0a8-9e1fd94266cb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:10.239189 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-540421d0-42b0-4c9b-a0a8-9e1fd94266cb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:10.242576 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-540421d0-42b0-4c9b-a0a8-9e1fd94266cb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:10.244020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-540421d0-42b0-4c9b-a0a8-9e1fd94266cb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.178927 Jun 14 19:44:10.245671 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 145/313] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:10 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:10.413238 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-e4b44911-c600-412e-b3c9-83cee123e9e5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:10.413787 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-e4b44911-c600-412e-b3c9-83cee123e9e5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:10.418548 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-313c6461-636e-49f5-af26-13b0d455130d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:10.420237 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e4b44911-c600-412e-b3c9-83cee123e9e5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:10.420648 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e4b44911-c600-412e-b3c9-83cee123e9e5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:10.421438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e4b44911-c600-412e-b3c9-83cee123e9e5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:10.422129 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e4b44911-c600-412e-b3c9-83cee123e9e5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:10.431566 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-313c6461-636e-49f5-af26-13b0d455130d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1723 microversion: 2.1 time: 0.279472 Jun 14 19:44:10.432138 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 169/314] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:10 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:10.497163 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e4b44911-c600-412e-b3c9-83cee123e9e5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:10.505965 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-e4b44911-c600-412e-b3c9-83cee123e9e5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1300 microversion: 2.1 time: 0.097966 Jun 14 19:44:10.508665 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 146/315] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:10 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:10.628560 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-97020485-e100-4cd5-906f-14feeac2fae0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:10.629539 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-97020485-e100-4cd5-906f-14feeac2fae0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:10.645783 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-97020485-e100-4cd5-906f-14feeac2fae0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:10.646614 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-97020485-e100-4cd5-906f-14feeac2fae0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:10.649058 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-97020485-e100-4cd5-906f-14feeac2fae0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:10.649882 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-97020485-e100-4cd5-906f-14feeac2fae0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:10.924196 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-97020485-e100-4cd5-906f-14feeac2fae0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:10.932898 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-97020485-e100-4cd5-906f-14feeac2fae0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1501 microversion: 2.1 time: 0.311995 Jun 14 19:44:10.933679 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 170/316] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:10 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1501 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:10.951444 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-3b47b776-765a-44e2-a324-e3a4830f8d95 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8600da67-33b5-4e75-8540-90831e865cc9"}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:10.956846 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-3b47b776-765a-44e2-a324-e3a4830f8d95 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:10.967250 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3b47b776-765a-44e2-a324-e3a4830f8d95 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:10.968116 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3b47b776-765a-44e2-a324-e3a4830f8d95 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:10.969713 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3b47b776-765a-44e2-a324-e3a4830f8d95 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:10.971051 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3b47b776-765a-44e2-a324-e3a4830f8d95 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:11.016312 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-3b47b776-765a-44e2-a324-e3a4830f8d95 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] HTTP exception thrown: Cannot 'attach_volume' instance 26a2c03a-7157-4585-b388-ae3fbf9913cb while it is in vm_state rescued Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-3b47b776-765a-44e2-a324-e3a4830f8d95 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Request method failure captured: Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: POST /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb/os-volume_attachments HTTP/1.1 Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 74 Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSXUwwI56eYhwPi9XEqhROraEksfHEb5IhPTbtyoll9ykvqMufFEeOqcOjWlLfF0jHg3hjdxlHtwds_NUimsgWEGN2iosCI_kqST9tecc6ZQuwsF46IreezwH9Tsojmvc-hqied-ovexRJRO7Dbf74R8f-SimKcNP1P1U9zDqlYnTE Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: 05db8610cfa7449daeec7419d4f7ad6c Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1296840289 Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:44:11.021064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:44:11.022406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05db8610cfa7449daeec7419d4f7ad6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_05db8610cfa7449daeec7419d4f7ad6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/05db8610cfa7449daeec7419d4f7ad6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05db8610cfa7449daeec7419d4f7ad6c"}]}] Jun 14 19:44:11.022406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1296840289 Jun 14 19:44:11.022406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: 05db8610cfa7449daeec7419d4f7ad6c Jun 14 19:44:11.022406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1296840289 Jun 14 19:44:11.022406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-ServerRescueNegativeTestJSON-1296840289-project Jun 14 19:44:11.022406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:44:11.022406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:44:11.022406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 9b28c3b97f9f44148dd02f41509887e8 Jun 14 19:44:11.022406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1296840289-project Jun 14 19:44:11.022406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Jun 14 19:44:11.022406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {"volumeAttachment": {"volumeId": "8600da67-33b5-4e75-8540-90831e865cc9"}} Jun 14 19:44:11.022406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Cannot 'attach_volume' instance 26a2c03a-7157-4585-b388-ae3fbf9913cb while it is in vm_state rescued Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'server_id': '26a2c03a-7157-4585-b388-ae3fbf9913cb', 'body': {'volumeAttachment': {'volumeId': '8600da67-33b5-4e75-8540-90831e865cc9'}}} Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 26a2c03a-7157-4585-b388-ae3fbf9913cb in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:44:11.023357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 26a2c03a-7157-4585-b388-ae3fbf9913cb while it is in vm_state rescued Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:44:11.024603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:44:11.025674 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:44:11.025674 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:44:11.025674 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 26a2c03a-7157-4585-b388-ae3fbf9913cb while it is in vm_state rescued Jun 14 19:44:11.025674 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:44:11.025674 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-3b47b776-765a-44e2-a324-e3a4830f8d95 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Returning 409 to user: Cannot 'attach_volume' instance 26a2c03a-7157-4585-b388-ae3fbf9913cb while it is in vm_state rescued {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:44:11.025674 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-3b47b776-765a-44e2-a324-e3a4830f8d95 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "POST /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.078159 Jun 14 19:44:11.026707 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 147/317] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 14 19:44:10 2022] POST /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb/os-volume_attachments => generated 152 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 14 19:44:11.037060 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-77a440d9-9a6f-48f5-bbad-7d98152bb124 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:11.037623 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-77a440d9-9a6f-48f5-bbad-7d98152bb124 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:11.044594 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-77a440d9-9a6f-48f5-bbad-7d98152bb124 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:11.045047 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-77a440d9-9a6f-48f5-bbad-7d98152bb124 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:11.045930 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-77a440d9-9a6f-48f5-bbad-7d98152bb124 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:11.046373 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-77a440d9-9a6f-48f5-bbad-7d98152bb124 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:11.130716 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-77a440d9-9a6f-48f5-bbad-7d98152bb124 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "POST /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb/action" status: 202 len: 0 microversion: 2.1 time: 0.097240 Jun 14 19:44:11.135168 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 171/318] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 14 19:44:11 2022] POST /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:44:11.145056 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ee15c37e-df56-4433-99ab-6b21e31c0a44 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:11.145820 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ee15c37e-df56-4433-99ab-6b21e31c0a44 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:11.160864 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ee15c37e-df56-4433-99ab-6b21e31c0a44 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:11.162048 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ee15c37e-df56-4433-99ab-6b21e31c0a44 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:11.163451 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ee15c37e-df56-4433-99ab-6b21e31c0a44 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:11.165995 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ee15c37e-df56-4433-99ab-6b21e31c0a44 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:11.263504 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9541e592-c9c7-4369-9ede-9c07e56519e9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:11.265206 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9541e592-c9c7-4369-9ede-9c07e56519e9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:11.277248 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9541e592-c9c7-4369-9ede-9c07e56519e9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:11.279947 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9541e592-c9c7-4369-9ede-9c07e56519e9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:11.280756 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9541e592-c9c7-4369-9ede-9c07e56519e9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:11.282149 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9541e592-c9c7-4369-9ede-9c07e56519e9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:11.373665 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-ee15c37e-df56-4433-99ab-6b21e31c0a44 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:11.385660 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-ee15c37e-df56-4433-99ab-6b21e31c0a44 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1509 microversion: 2.1 time: 0.248596 Jun 14 19:44:11.386781 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 148/319] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:11 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:11.448740 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-bf2cf3fe-2fd5-44fb-a412-872f5bd8f889 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:11.449350 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-bf2cf3fe-2fd5-44fb-a412-872f5bd8f889 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:11.457247 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bf2cf3fe-2fd5-44fb-a412-872f5bd8f889 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:11.458017 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bf2cf3fe-2fd5-44fb-a412-872f5bd8f889 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:11.459075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bf2cf3fe-2fd5-44fb-a412-872f5bd8f889 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:11.459774 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bf2cf3fe-2fd5-44fb-a412-872f5bd8f889 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:11.848442 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9541e592-c9c7-4369-9ede-9c07e56519e9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:11.858635 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9541e592-c9c7-4369-9ede-9c07e56519e9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:11.864864 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9541e592-c9c7-4369-9ede-9c07e56519e9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:11.866117 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9541e592-c9c7-4369-9ede-9c07e56519e9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.607040 Jun 14 19:44:11.870995 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 172/320] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:11 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:11.880336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-8a5ad700-fd44-435a-a774-e88a8a022528 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:11.881264 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8a5ad700-fd44-435a-a774-e88a8a022528 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:11.889781 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-bf2cf3fe-2fd5-44fb-a412-872f5bd8f889 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:11.901678 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8a5ad700-fd44-435a-a774-e88a8a022528 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:11.902131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8a5ad700-fd44-435a-a774-e88a8a022528 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:11.902911 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8a5ad700-fd44-435a-a774-e88a8a022528 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:11.903343 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8a5ad700-fd44-435a-a774-e88a8a022528 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:11.904383 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-bf2cf3fe-2fd5-44fb-a412-872f5bd8f889 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1723 microversion: 2.1 time: 0.459867 Jun 14 19:44:11.911672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 149/321] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:11 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1723 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:12.215330 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-8a5ad700-fd44-435a-a774-e88a8a022528 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:12.225973 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-8a5ad700-fd44-435a-a774-e88a8a022528 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1368 microversion: 2.1 time: 0.353789 Jun 14 19:44:12.226810 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 173/322] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:11 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1368 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:12.404944 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9a6854e5-8c68-4a93-ae94-44686774aa1c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:12.406311 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9a6854e5-8c68-4a93-ae94-44686774aa1c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:12.434663 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a6854e5-8c68-4a93-ae94-44686774aa1c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:12.435462 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a6854e5-8c68-4a93-ae94-44686774aa1c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:12.437083 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a6854e5-8c68-4a93-ae94-44686774aa1c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:12.438018 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a6854e5-8c68-4a93-ae94-44686774aa1c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:12.672914 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9a6854e5-8c68-4a93-ae94-44686774aa1c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:12.681864 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9a6854e5-8c68-4a93-ae94-44686774aa1c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1509 microversion: 2.1 time: 0.281885 Jun 14 19:44:12.691862 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 150/323] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:12 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:12.746294 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-82eabb63-f4f7-4e63-8a2e-6973aa198672 req-bf8e3849-a2b9-4072-99a0-63577c295d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e2353fc-c6c0-4c56-8423-5bc7b343acc7", "tag": "90b7f081-458d-4545-b9cc-146a82537268"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:12.758951 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-82eabb63-f4f7-4e63-8a2e-6973aa198672 req-bf8e3849-a2b9-4072-99a0-63577c295d93 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:12.762848 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-82eabb63-f4f7-4e63-8a2e-6973aa198672 req-bf8e3849-a2b9-4072-99a0-63577c295d93 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:12.779606 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-82eabb63-f4f7-4e63-8a2e-6973aa198672 req-bf8e3849-a2b9-4072-99a0-63577c295d93 service nova] Creating event network-changed:90b7f081-458d-4545-b9cc-146a82537268 for instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 on hv-cinder-84580 Jun 14 19:44:12.787164 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-82eabb63-f4f7-4e63-8a2e-6973aa198672 req-bf8e3849-a2b9-4072-99a0-63577c295d93 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044702 Jun 14 19:44:12.789005 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 174/324] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:44:12.887397 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-48b376b1-8742-4b13-8439-ab78f457ace5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:12.888021 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-48b376b1-8742-4b13-8439-ab78f457ace5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:12.900221 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-48b376b1-8742-4b13-8439-ab78f457ace5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:12.900706 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-48b376b1-8742-4b13-8439-ab78f457ace5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:12.901526 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-48b376b1-8742-4b13-8439-ab78f457ace5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:12.901973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-48b376b1-8742-4b13-8439-ab78f457ace5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:12.924406 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-2ac5cc94-eae6-41c1-bb4f-dadb3d10b067 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:12.925512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-2ac5cc94-eae6-41c1-bb4f-dadb3d10b067 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:12.941961 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2ac5cc94-eae6-41c1-bb4f-dadb3d10b067 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:12.942667 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2ac5cc94-eae6-41c1-bb4f-dadb3d10b067 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:12.943525 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2ac5cc94-eae6-41c1-bb4f-dadb3d10b067 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:12.944112 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2ac5cc94-eae6-41c1-bb4f-dadb3d10b067 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:13.064998 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-48b376b1-8742-4b13-8439-ab78f457ace5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:13.073814 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-48b376b1-8742-4b13-8439-ab78f457ace5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:13.075329 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-48b376b1-8742-4b13-8439-ab78f457ace5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:13.076478 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-48b376b1-8742-4b13-8439-ab78f457ace5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1743 microversion: 2.20 time: 0.195876 Jun 14 19:44:13.077034 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 151/325] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:12 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1743 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:13.099402 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-2ac5cc94-eae6-41c1-bb4f-dadb3d10b067 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:13.107285 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-2ac5cc94-eae6-41c1-bb4f-dadb3d10b067 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1723 microversion: 2.1 time: 0.188085 Jun 14 19:44:13.107846 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 175/326] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:12 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:13.243566 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a654ca71-3a35-42b9-aaa9-3d67cd2ce664 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:13.244168 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a654ca71-3a35-42b9-aaa9-3d67cd2ce664 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:13.250053 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a654ca71-3a35-42b9-aaa9-3d67cd2ce664 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:13.250497 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a654ca71-3a35-42b9-aaa9-3d67cd2ce664 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:13.251250 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a654ca71-3a35-42b9-aaa9-3d67cd2ce664 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:13.251672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a654ca71-3a35-42b9-aaa9-3d67cd2ce664 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:13.402182 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a654ca71-3a35-42b9-aaa9-3d67cd2ce664 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:13.412296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a654ca71-3a35-42b9-aaa9-3d67cd2ce664 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1368 microversion: 2.1 time: 0.173237 Jun 14 19:44:13.415351 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 152/327] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:13 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:13.698569 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3828398a-4414-4581-a523-2e7fe60c7d4c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:13.699180 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3828398a-4414-4581-a523-2e7fe60c7d4c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:13.707049 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3828398a-4414-4581-a523-2e7fe60c7d4c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:13.708015 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3828398a-4414-4581-a523-2e7fe60c7d4c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:13.708846 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3828398a-4414-4581-a523-2e7fe60c7d4c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:13.709244 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3828398a-4414-4581-a523-2e7fe60c7d4c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:13.852183 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3828398a-4414-4581-a523-2e7fe60c7d4c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:13.860049 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3828398a-4414-4581-a523-2e7fe60c7d4c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1509 microversion: 2.1 time: 0.165812 Jun 14 19:44:13.860611 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 176/328] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:13 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:14.094896 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-5acfa170-578b-42a3-b07d-127d0e07f586 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:14.095501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-5acfa170-578b-42a3-b07d-127d0e07f586 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:14.102645 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5acfa170-578b-42a3-b07d-127d0e07f586 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:14.103097 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5acfa170-578b-42a3-b07d-127d0e07f586 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:14.103867 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5acfa170-578b-42a3-b07d-127d0e07f586 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:14.104412 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5acfa170-578b-42a3-b07d-127d0e07f586 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:14.125143 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-2f7fc398-8eed-4bed-b83c-51f175c0d655 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:14.125790 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-2f7fc398-8eed-4bed-b83c-51f175c0d655 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:14.133315 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2f7fc398-8eed-4bed-b83c-51f175c0d655 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:14.134020 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2f7fc398-8eed-4bed-b83c-51f175c0d655 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:14.135083 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2f7fc398-8eed-4bed-b83c-51f175c0d655 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:14.135387 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2f7fc398-8eed-4bed-b83c-51f175c0d655 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:14.252329 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-5acfa170-578b-42a3-b07d-127d0e07f586 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:14.262648 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-5acfa170-578b-42a3-b07d-127d0e07f586 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:14.264740 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-5acfa170-578b-42a3-b07d-127d0e07f586 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:14.266208 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-5acfa170-578b-42a3-b07d-127d0e07f586 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1743 microversion: 2.20 time: 0.175111 Jun 14 19:44:14.267063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 153/329] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:14 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:14.290270 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-2f7fc398-8eed-4bed-b83c-51f175c0d655 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:14.298161 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-2f7fc398-8eed-4bed-b83c-51f175c0d655 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1723 microversion: 2.1 time: 0.177913 Jun 14 19:44:14.298896 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 177/330] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:14 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:14.431893 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-089de622-8318-4d31-a01c-0a3fbf31d836 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:14.432509 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-089de622-8318-4d31-a01c-0a3fbf31d836 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:14.438550 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-089de622-8318-4d31-a01c-0a3fbf31d836 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:14.439005 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-089de622-8318-4d31-a01c-0a3fbf31d836 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:14.439769 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-089de622-8318-4d31-a01c-0a3fbf31d836 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:14.440201 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-089de622-8318-4d31-a01c-0a3fbf31d836 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:14.574490 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-089de622-8318-4d31-a01c-0a3fbf31d836 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:14.585532 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-089de622-8318-4d31-a01c-0a3fbf31d836 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1368 microversion: 2.1 time: 0.158061 Jun 14 19:44:14.586821 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 154/331] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:14 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:14.877775 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a23adba0-133e-40fd-9687-d99d2e3cc737 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:14.878668 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a23adba0-133e-40fd-9687-d99d2e3cc737 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:14.886009 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a23adba0-133e-40fd-9687-d99d2e3cc737 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:14.886529 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a23adba0-133e-40fd-9687-d99d2e3cc737 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:14.887535 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a23adba0-133e-40fd-9687-d99d2e3cc737 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:14.888035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a23adba0-133e-40fd-9687-d99d2e3cc737 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:15.035814 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a23adba0-133e-40fd-9687-d99d2e3cc737 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:15.045154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a23adba0-133e-40fd-9687-d99d2e3cc737 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1509 microversion: 2.1 time: 0.171947 Jun 14 19:44:15.045749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 178/332] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:14 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:15.284874 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1969aef3-413b-48c8-b485-204734458175 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:15.285538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-1969aef3-413b-48c8-b485-204734458175 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:15.292538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1969aef3-413b-48c8-b485-204734458175 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:15.292980 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1969aef3-413b-48c8-b485-204734458175 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:15.293766 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1969aef3-413b-48c8-b485-204734458175 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:15.294195 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1969aef3-413b-48c8-b485-204734458175 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:15.315467 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1afe8086-b371-4b00-994f-6b65ce8bbc31 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:15.316097 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1afe8086-b371-4b00-994f-6b65ce8bbc31 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:15.322187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1afe8086-b371-4b00-994f-6b65ce8bbc31 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:15.322630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1afe8086-b371-4b00-994f-6b65ce8bbc31 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:15.323450 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1afe8086-b371-4b00-994f-6b65ce8bbc31 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:15.323889 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1afe8086-b371-4b00-994f-6b65ce8bbc31 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:15.507064 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1afe8086-b371-4b00-994f-6b65ce8bbc31 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:15.520351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1afe8086-b371-4b00-994f-6b65ce8bbc31 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1723 microversion: 2.1 time: 0.208379 Jun 14 19:44:15.522140 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 179/333] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:15 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:15.586003 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-a89c4001-73f7-4ee5-8308-7f22ce9adce4 req-26988282-5089-4740-b886-4b8e850a8fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2d9ed3-941a-496c-b3c8-a9a5648cd846", "name": "network-vif-plugged", "status": "completed", "tag": "5445a8aa-6257-4a17-8a1b-eff254fa9a9d"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:15.598534 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-a89c4001-73f7-4ee5-8308-7f22ce9adce4 req-26988282-5089-4740-b886-4b8e850a8fa4 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:15.600084 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-a89c4001-73f7-4ee5-8308-7f22ce9adce4 req-26988282-5089-4740-b886-4b8e850a8fa4 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:15.616592 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-a89c4001-73f7-4ee5-8308-7f22ce9adce4 req-26988282-5089-4740-b886-4b8e850a8fa4 service nova] Creating event network-vif-plugged:5445a8aa-6257-4a17-8a1b-eff254fa9a9d for instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 on hv-cinder-84580 Jun 14 19:44:15.624364 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-a89c4001-73f7-4ee5-8308-7f22ce9adce4 req-26988282-5089-4740-b886-4b8e850a8fa4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042731 Jun 14 19:44:15.625991 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 180/334] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:44:15.633061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-98a9d447-df3c-4a66-be8f-22f19d619a41 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:15.634084 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-98a9d447-df3c-4a66-be8f-22f19d619a41 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:15.642095 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-98a9d447-df3c-4a66-be8f-22f19d619a41 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:15.642904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-98a9d447-df3c-4a66-be8f-22f19d619a41 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:15.644048 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-98a9d447-df3c-4a66-be8f-22f19d619a41 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:15.644706 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-98a9d447-df3c-4a66-be8f-22f19d619a41 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:15.656840 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-1969aef3-413b-48c8-b485-204734458175 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:15.670234 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-1969aef3-413b-48c8-b485-204734458175 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:15.672487 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-1969aef3-413b-48c8-b485-204734458175 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:15.674491 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-1969aef3-413b-48c8-b485-204734458175 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1743 microversion: 2.20 time: 0.393451 Jun 14 19:44:15.675215 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 155/335] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:15 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1743 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:15.838631 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-98a9d447-df3c-4a66-be8f-22f19d619a41 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:15.846555 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-98a9d447-df3c-4a66-be8f-22f19d619a41 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1368 microversion: 2.1 time: 0.218750 Jun 14 19:44:15.847113 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 181/336] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:15 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:16.071387 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-7defff98-d8a6-4ae7-8fe7-582922a70acf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:16.072002 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-7defff98-d8a6-4ae7-8fe7-582922a70acf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:16.078984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7defff98-d8a6-4ae7-8fe7-582922a70acf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:16.079688 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7defff98-d8a6-4ae7-8fe7-582922a70acf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:16.080719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7defff98-d8a6-4ae7-8fe7-582922a70acf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:16.081306 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7defff98-d8a6-4ae7-8fe7-582922a70acf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:16.237596 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-7defff98-d8a6-4ae7-8fe7-582922a70acf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:16.245231 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-7defff98-d8a6-4ae7-8fe7-582922a70acf tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1509 microversion: 2.1 time: 0.177874 Jun 14 19:44:16.254676 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 156/337] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:16 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:16.539119 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-aee2af76-8fc9-4241-b252-4160b4acefa3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:16.539833 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-aee2af76-8fc9-4241-b252-4160b4acefa3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:16.546750 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aee2af76-8fc9-4241-b252-4160b4acefa3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:16.547202 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aee2af76-8fc9-4241-b252-4160b4acefa3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:16.547974 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aee2af76-8fc9-4241-b252-4160b4acefa3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:16.548426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aee2af76-8fc9-4241-b252-4160b4acefa3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:16.696655 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-0c17a019-7f38-459c-a456-62209e4172c2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:16.697270 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-0c17a019-7f38-459c-a456-62209e4172c2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:16.700112 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-aee2af76-8fc9-4241-b252-4160b4acefa3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:16.704451 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:16.714707 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c17a019-7f38-459c-a456-62209e4172c2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:16.714895 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c17a019-7f38-459c-a456-62209e4172c2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:16.715648 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c17a019-7f38-459c-a456-62209e4172c2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:16.716083 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c17a019-7f38-459c-a456-62209e4172c2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:16.721998 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-aee2af76-8fc9-4241-b252-4160b4acefa3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1723 microversion: 2.1 time: 0.186590 Jun 14 19:44:16.722575 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 182/338] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:16 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:16.861078 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-0c17a019-7f38-459c-a456-62209e4172c2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:16.863902 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-409aefeb-13a6-49df-8c7b-08ae6d88717d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:16.864531 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-409aefeb-13a6-49df-8c7b-08ae6d88717d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:16.870581 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-0c17a019-7f38-459c-a456-62209e4172c2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:16.872370 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-0c17a019-7f38-459c-a456-62209e4172c2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:16.872956 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-409aefeb-13a6-49df-8c7b-08ae6d88717d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:16.873629 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-409aefeb-13a6-49df-8c7b-08ae6d88717d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:16.873745 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-0c17a019-7f38-459c-a456-62209e4172c2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1743 microversion: 2.20 time: 0.181531 Jun 14 19:44:16.875158 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-409aefeb-13a6-49df-8c7b-08ae6d88717d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:16.875736 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-409aefeb-13a6-49df-8c7b-08ae6d88717d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:16.885196 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 157/339] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:16 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1743 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:16.894849 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:17.115621 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-409aefeb-13a6-49df-8c7b-08ae6d88717d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:17.123217 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-409aefeb-13a6-49df-8c7b-08ae6d88717d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1368 microversion: 2.1 time: 0.263622 Jun 14 19:44:17.133359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 183/340] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:16 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:17.263273 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1cf84b82-9f54-44ef-b39e-08b9ca2eb67e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:17.263912 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-1cf84b82-9f54-44ef-b39e-08b9ca2eb67e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:17.271418 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1cf84b82-9f54-44ef-b39e-08b9ca2eb67e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:17.272085 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1cf84b82-9f54-44ef-b39e-08b9ca2eb67e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:17.273725 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1cf84b82-9f54-44ef-b39e-08b9ca2eb67e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:17.274337 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1cf84b82-9f54-44ef-b39e-08b9ca2eb67e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:17.439226 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-1cf84b82-9f54-44ef-b39e-08b9ca2eb67e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:17.447291 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-1cf84b82-9f54-44ef-b39e-08b9ca2eb67e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1515 microversion: 2.1 time: 0.189026 Jun 14 19:44:17.449168 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 158/341] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:17 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:17.741189 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b8f1af56-dc9c-449f-83a1-6752d11bd4b1 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:17.742975 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b8f1af56-dc9c-449f-83a1-6752d11bd4b1 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:17.755663 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b8f1af56-dc9c-449f-83a1-6752d11bd4b1 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:17.757699 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b8f1af56-dc9c-449f-83a1-6752d11bd4b1 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:17.758901 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b8f1af56-dc9c-449f-83a1-6752d11bd4b1 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:17.759493 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b8f1af56-dc9c-449f-83a1-6752d11bd4b1 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:17.892687 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a03d046a-f51a-424f-80f1-e26e61701517 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:17.894050 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a03d046a-f51a-424f-80f1-e26e61701517 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:17.912047 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a03d046a-f51a-424f-80f1-e26e61701517 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:17.915343 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a03d046a-f51a-424f-80f1-e26e61701517 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:17.918574 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a03d046a-f51a-424f-80f1-e26e61701517 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:17.919960 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a03d046a-f51a-424f-80f1-e26e61701517 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:17.997910 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:18.031283 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b8f1af56-dc9c-449f-83a1-6752d11bd4b1 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:18.041494 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b8f1af56-dc9c-449f-83a1-6752d11bd4b1 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1723 microversion: 2.1 time: 0.305239 Jun 14 19:44:18.045113 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 184/342] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:17 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:18.141446 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-76863505-fc5b-451a-86cb-25ee75618dae tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:18.142206 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-76863505-fc5b-451a-86cb-25ee75618dae tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:18.150759 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a03d046a-f51a-424f-80f1-e26e61701517 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:18.160631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=100 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:18.165148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:18.169851 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-76863505-fc5b-451a-86cb-25ee75618dae tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:18.170895 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a03d046a-f51a-424f-80f1-e26e61701517 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:18.171136 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-76863505-fc5b-451a-86cb-25ee75618dae tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:18.172246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-76863505-fc5b-451a-86cb-25ee75618dae tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:18.174141 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a03d046a-f51a-424f-80f1-e26e61701517 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:18.174863 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-76863505-fc5b-451a-86cb-25ee75618dae tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:18.178147 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a03d046a-f51a-424f-80f1-e26e61701517 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1738 microversion: 2.20 time: 0.290013 Jun 14 19:44:18.182626 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 159/343] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:17 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1738 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:44:18.341180 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-76863505-fc5b-451a-86cb-25ee75618dae tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:18.352876 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-76863505-fc5b-451a-86cb-25ee75618dae tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1368 microversion: 2.1 time: 0.215960 Jun 14 19:44:18.362294 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 185/344] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:18 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:19.003101 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-cd08b4ed-4673-4ab3-a0ef-0ea295317de9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Action: 'create', calling method: .version_select at 0x7f14500c0f70>, body: {"keypair": {"name": "tempest-keypair-362722115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiHurshgiQMQBnCcyCd19AlIvVjpQX2LEp7UHkC6e93CwKd0cH0BhmZXwlJOqWUnQ1YNgP5ubGzkFJeSXurd0KT6JtcqkDDuwWLvoPPpby5B7jm6e9C2lgQHfMkPRWdvA=="}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:19.012192 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=8 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:19.031065 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-cd08b4ed-4673-4ab3-a0ef-0ea295317de9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Getting quotas for project 05db8610cfa7449daeec7419d4f7ad6c. Resources: {'key_pairs'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:44:19.039937 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-cd08b4ed-4673-4ab3-a0ef-0ea295317de9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Getting quotas for user 9b28c3b97f9f44148dd02f41509887e8 and project 05db8610cfa7449daeec7419d4f7ad6c. Resources: {'key_pairs'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:44:19.059200 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-495c8f1d-e6bf-44b0-9395-e685c19b7807 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:19.060321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-495c8f1d-e6bf-44b0-9395-e685c19b7807 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:19.067941 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-495c8f1d-e6bf-44b0-9395-e685c19b7807 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:19.071971 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-495c8f1d-e6bf-44b0-9395-e685c19b7807 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:19.072977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-495c8f1d-e6bf-44b0-9395-e685c19b7807 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:19.077611 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-495c8f1d-e6bf-44b0-9395-e685c19b7807 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:19.090957 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-cd08b4ed-4673-4ab3-a0ef-0ea295317de9 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.094885 Jun 14 19:44:19.096793 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 160/345] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 14 19:44:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:44:19.204016 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a0c4d2f5-3890-4a31-a750-629b9db797de tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:19.205205 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a0c4d2f5-3890-4a31-a750-629b9db797de tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:19.220173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a0c4d2f5-3890-4a31-a750-629b9db797de tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:19.221893 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a0c4d2f5-3890-4a31-a750-629b9db797de tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:19.223705 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a0c4d2f5-3890-4a31-a750-629b9db797de tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:19.225141 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a0c4d2f5-3890-4a31-a750-629b9db797de tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:19.293921 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-495c8f1d-e6bf-44b0-9395-e685c19b7807 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:19.306735 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-495c8f1d-e6bf-44b0-9395-e685c19b7807 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1723 microversion: 2.1 time: 0.251857 Jun 14 19:44:19.322303 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 186/346] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:19 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:19.371798 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-65e9ceaa-e8c9-4b83-8af3-18ed7a3e751b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:19.373710 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-65e9ceaa-e8c9-4b83-8af3-18ed7a3e751b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:19.386786 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-65e9ceaa-e8c9-4b83-8af3-18ed7a3e751b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:19.387614 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-65e9ceaa-e8c9-4b83-8af3-18ed7a3e751b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:19.390646 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-65e9ceaa-e8c9-4b83-8af3-18ed7a3e751b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:19.391207 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-65e9ceaa-e8c9-4b83-8af3-18ed7a3e751b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:19.392510 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a0c4d2f5-3890-4a31-a750-629b9db797de tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:19.407655 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a0c4d2f5-3890-4a31-a750-629b9db797de tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:19.413739 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a0c4d2f5-3890-4a31-a750-629b9db797de tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:19.420233 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a0c4d2f5-3890-4a31-a750-629b9db797de tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1738 microversion: 2.20 time: 0.223574 Jun 14 19:44:19.422267 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 161/347] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:19 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:19.648706 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-65e9ceaa-e8c9-4b83-8af3-18ed7a3e751b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:19.662900 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-65e9ceaa-e8c9-4b83-8af3-18ed7a3e751b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1368 microversion: 2.1 time: 0.296684 Jun 14 19:44:19.674862 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 187/348] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:19 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1368 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:19.724599 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-cf0336a6-68dd-4500-98e9-f41aa5ae4196 req-8ae388c2-5f25-4156-a39c-8646e379790f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2353fc-c6c0-4c56-8423-5bc7b343acc7", "name": "network-vif-plugged", "status": "completed", "tag": "90b7f081-458d-4545-b9cc-146a82537268"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:19.743792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-cf0336a6-68dd-4500-98e9-f41aa5ae4196 req-8ae388c2-5f25-4156-a39c-8646e379790f service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:19.746252 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-cf0336a6-68dd-4500-98e9-f41aa5ae4196 req-8ae388c2-5f25-4156-a39c-8646e379790f service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:19.790115 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-cf0336a6-68dd-4500-98e9-f41aa5ae4196 req-8ae388c2-5f25-4156-a39c-8646e379790f service nova] Creating event network-vif-plugged:90b7f081-458d-4545-b9cc-146a82537268 for instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 on hv-cinder-84580 Jun 14 19:44:19.796618 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-cf0336a6-68dd-4500-98e9-f41aa5ae4196 req-8ae388c2-5f25-4156-a39c-8646e379790f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078714 Jun 14 19:44:19.797659 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 162/349] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:44:20.329420 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d257647c-6a3d-4bff-aa84-4dad7fd09d90 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:20.330531 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d257647c-6a3d-4bff-aa84-4dad7fd09d90 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:20.346760 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d257647c-6a3d-4bff-aa84-4dad7fd09d90 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:20.347253 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d257647c-6a3d-4bff-aa84-4dad7fd09d90 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:20.348051 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d257647c-6a3d-4bff-aa84-4dad7fd09d90 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:20.349346 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d257647c-6a3d-4bff-aa84-4dad7fd09d90 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:20.443416 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c74721af-54a6-4767-8c65-177c9cbdf585 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:20.445229 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c74721af-54a6-4767-8c65-177c9cbdf585 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:20.469103 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c74721af-54a6-4767-8c65-177c9cbdf585 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:20.470102 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c74721af-54a6-4767-8c65-177c9cbdf585 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:20.471562 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c74721af-54a6-4767-8c65-177c9cbdf585 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:20.473003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c74721af-54a6-4767-8c65-177c9cbdf585 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:20.758657 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c74721af-54a6-4767-8c65-177c9cbdf585 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:20.773874 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c74721af-54a6-4767-8c65-177c9cbdf585 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:20.775430 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c74721af-54a6-4767-8c65-177c9cbdf585 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:20.776644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c74721af-54a6-4767-8c65-177c9cbdf585 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1738 microversion: 2.20 time: 0.340212 Jun 14 19:44:20.777203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 163/350] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:20 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1738 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:44:20.796253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a097b1a6-0f20-418f-a04b-265fe925411f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:20.796870 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a097b1a6-0f20-418f-a04b-265fe925411f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:20.825666 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a097b1a6-0f20-418f-a04b-265fe925411f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:20.827032 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a097b1a6-0f20-418f-a04b-265fe925411f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:20.827819 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a097b1a6-0f20-418f-a04b-265fe925411f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:20.828252 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a097b1a6-0f20-418f-a04b-265fe925411f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:20.869806 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d257647c-6a3d-4bff-aa84-4dad7fd09d90 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:20.878776 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d257647c-6a3d-4bff-aa84-4dad7fd09d90 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1723 microversion: 2.1 time: 0.554622 Jun 14 19:44:20.886609 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 188/351] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:20 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1723 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:21.333636 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a097b1a6-0f20-418f-a04b-265fe925411f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:21.342556 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a097b1a6-0f20-418f-a04b-265fe925411f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1368 microversion: 2.1 time: 0.549916 Jun 14 19:44:21.343343 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 164/352] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:20 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1368 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:21.800404 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d136ae0a-d30f-48b6-b000-c698e14f1f74 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:21.802467 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d136ae0a-d30f-48b6-b000-c698e14f1f74 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:21.825069 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d136ae0a-d30f-48b6-b000-c698e14f1f74 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:21.830254 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d136ae0a-d30f-48b6-b000-c698e14f1f74 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:21.831160 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d136ae0a-d30f-48b6-b000-c698e14f1f74 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:21.832867 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d136ae0a-d30f-48b6-b000-c698e14f1f74 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:21.902680 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2ae383a4-f21f-4026-a97d-c47e87985f0c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:21.906151 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2ae383a4-f21f-4026-a97d-c47e87985f0c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:21.918663 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2ae383a4-f21f-4026-a97d-c47e87985f0c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:21.920064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2ae383a4-f21f-4026-a97d-c47e87985f0c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:21.922494 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2ae383a4-f21f-4026-a97d-c47e87985f0c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:21.922944 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2ae383a4-f21f-4026-a97d-c47e87985f0c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:22.107023 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d136ae0a-d30f-48b6-b000-c698e14f1f74 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:22.124913 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d136ae0a-d30f-48b6-b000-c698e14f1f74 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:22.128977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d136ae0a-d30f-48b6-b000-c698e14f1f74 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:22.135501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d136ae0a-d30f-48b6-b000-c698e14f1f74 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1738 microversion: 2.20 time: 0.339078 Jun 14 19:44:22.136175 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 189/353] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:21 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1738 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:22.165698 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-946527878", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "306322ef-3e3f-44b4-b241-274a6f9c3423"}], "security_groups": [{"name": "tempest-securitygroup--171545864"}], "key_name": "tempest-keypair-362722115", "user_data": "}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:22.199941 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2ae383a4-f21f-4026-a97d-c47e87985f0c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:22.226808 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2ae383a4-f21f-4026-a97d-c47e87985f0c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1700 microversion: 2.1 time: 0.328135 Jun 14 19:44:22.231232 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 165/354] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:21 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1700 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:22.252621 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-88825113-cd98-4377-a120-178562a5a085 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:22.266350 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-88825113-cd98-4377-a120-178562a5a085 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:22.267827 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-88825113-cd98-4377-a120-178562a5a085 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:22.352866 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.network.neutron [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] validate_networks() for [('306322ef-3e3f-44b4-b241-274a6f9c3423', None, None, None, None, None)] {{(pid=124068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:44:22.396270 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-88825113-cd98-4377-a120-178562a5a085 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Going to try to start instance {{(pid=124069) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 14 19:44:22.474300 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-88825113-cd98-4377-a120-178562a5a085 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "POST /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/action" status: 202 len: 0 microversion: 2.1 time: 0.227665 Jun 14 19:44:22.476430 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 166/355] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 14 19:44:22 2022] POST /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 19:44:22.488679 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-472aa011-1554-4bf7-9dcd-7373e0c55cea tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:22.490646 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-472aa011-1554-4bf7-9dcd-7373e0c55cea tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:22.516046 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-472aa011-1554-4bf7-9dcd-7373e0c55cea tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:22.516662 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-472aa011-1554-4bf7-9dcd-7373e0c55cea tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:22.523449 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-472aa011-1554-4bf7-9dcd-7373e0c55cea tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:22.523904 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-472aa011-1554-4bf7-9dcd-7373e0c55cea tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:22.753484 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-472aa011-1554-4bf7-9dcd-7373e0c55cea tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:22.765894 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-472aa011-1554-4bf7-9dcd-7373e0c55cea tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1557 microversion: 2.1 time: 0.287927 Jun 14 19:44:22.769154 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 167/356] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:22 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1557 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:22.774143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-0e350a36-569c-4f14-939e-d4516b4d41b3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:22.777628 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-0e350a36-569c-4f14-939e-d4516b4d41b3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:22.797972 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0e350a36-569c-4f14-939e-d4516b4d41b3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:22.803491 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0e350a36-569c-4f14-939e-d4516b4d41b3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:22.808217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0e350a36-569c-4f14-939e-d4516b4d41b3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:22.809223 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0e350a36-569c-4f14-939e-d4516b4d41b3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:23.115608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-0e350a36-569c-4f14-939e-d4516b4d41b3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:23.124819 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-0e350a36-569c-4f14-939e-d4516b4d41b3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1709 microversion: 2.1 time: 0.354363 Jun 14 19:44:23.134913 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 168/357] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:22 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1709 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:23.134913 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-54fb11a7-01fb-4bc3-af57-1460cef74cec tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:23.134913 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-54fb11a7-01fb-4bc3-af57-1460cef74cec tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:23.141295 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-54fb11a7-01fb-4bc3-af57-1460cef74cec tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:23.141956 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-54fb11a7-01fb-4bc3-af57-1460cef74cec tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:23.143419 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-54fb11a7-01fb-4bc3-af57-1460cef74cec tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:23.143999 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-54fb11a7-01fb-4bc3-af57-1460cef74cec tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:23.316471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-54fb11a7-01fb-4bc3-af57-1460cef74cec tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.189770 Jun 14 19:44:23.317295 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 169/358] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 14 19:44:23 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:44:23.322716 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-892d9d65-cb1d-46fa-9411-188f4f50ce47 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:23.323324 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-892d9d65-cb1d-46fa-9411-188f4f50ce47 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:23.336468 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Flavor limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:44:23.337669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Image limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:44:23.338426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Flavor pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:44:23.339050 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Image pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:44:23.339445 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-892d9d65-cb1d-46fa-9411-188f4f50ce47 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:23.339910 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-892d9d65-cb1d-46fa-9411-188f4f50ce47 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:23.340190 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:44:23.341296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-892d9d65-cb1d-46fa-9411-188f4f50ce47 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:23.341771 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-892d9d65-cb1d-46fa-9411-188f4f50ce47 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:23.356954 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:23.359286 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:23.362342 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:23.363033 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:23.416981 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Getting quotas for project 05db8610cfa7449daeec7419d4f7ad6c. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:44:23.425318 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Getting quotas for user 9b28c3b97f9f44148dd02f41509887e8 and project 05db8610cfa7449daeec7419d4f7ad6c. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:44:23.451583 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Going to run 1 instances... {{(pid=124068) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:44:23.457204 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:44:23.567637 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b80410cc-34e9-46c4-a52e-3c73d27ed70a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.430237 Jun 14 19:44:23.568193 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 190/359] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:44:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 1431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:44:23.588380 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-216ee7e9-ae88-4c02-9961-8222a248a11f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:23.589066 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-216ee7e9-ae88-4c02-9961-8222a248a11f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:23.704426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-216ee7e9-ae88-4c02-9961-8222a248a11f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:23.712092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-216ee7e9-ae88-4c02-9961-8222a248a11f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1244 microversion: 2.1 time: 0.137364 Jun 14 19:44:23.744104 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 191/360] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:23 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1244 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:23.772466 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-892d9d65-cb1d-46fa-9411-188f4f50ce47 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:23.781209 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-892d9d65-cb1d-46fa-9411-188f4f50ce47 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:23.782644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-892d9d65-cb1d-46fa-9411-188f4f50ce47 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:23.783810 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-892d9d65-cb1d-46fa-9411-188f4f50ce47 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1738 microversion: 2.20 time: 0.465413 Jun 14 19:44:23.784356 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 170/361] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:23 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1738 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:24.146395 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-5a7c1e5b-abab-4c16-8836-82c9122437b0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:24.147057 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-5a7c1e5b-abab-4c16-8836-82c9122437b0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:24.175278 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5a7c1e5b-abab-4c16-8836-82c9122437b0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:24.175862 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5a7c1e5b-abab-4c16-8836-82c9122437b0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:24.181246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5a7c1e5b-abab-4c16-8836-82c9122437b0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:24.184175 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5a7c1e5b-abab-4c16-8836-82c9122437b0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:24.502537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-5a7c1e5b-abab-4c16-8836-82c9122437b0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:24.512791 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-5a7c1e5b-abab-4c16-8836-82c9122437b0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1709 microversion: 2.1 time: 0.374011 Jun 14 19:44:24.514385 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 192/362] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:24 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1709 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:24.728654 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-79ba75f6-94a8-4c59-b91d-6afb63d77ead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:24.730132 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-79ba75f6-94a8-4c59-b91d-6afb63d77ead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:24.738998 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-79ba75f6-94a8-4c59-b91d-6afb63d77ead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:24.739484 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-79ba75f6-94a8-4c59-b91d-6afb63d77ead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:24.742497 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-79ba75f6-94a8-4c59-b91d-6afb63d77ead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:24.744305 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-79ba75f6-94a8-4c59-b91d-6afb63d77ead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:24.804524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b1f722b2-32a6-4cd6-84e7-c086b76e760c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:24.805597 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b1f722b2-32a6-4cd6-84e7-c086b76e760c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:24.836643 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b1f722b2-32a6-4cd6-84e7-c086b76e760c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:24.837401 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b1f722b2-32a6-4cd6-84e7-c086b76e760c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:24.838823 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b1f722b2-32a6-4cd6-84e7-c086b76e760c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:24.839418 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b1f722b2-32a6-4cd6-84e7-c086b76e760c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:24.881287 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-79ba75f6-94a8-4c59-b91d-6afb63d77ead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:24.893715 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-79ba75f6-94a8-4c59-b91d-6afb63d77ead tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1240 microversion: 2.1 time: 0.169141 Jun 14 19:44:24.906657 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 171/363] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:24 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1240 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:25.056564 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b1f722b2-32a6-4cd6-84e7-c086b76e760c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:25.084392 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b1f722b2-32a6-4cd6-84e7-c086b76e760c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:25.090164 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b1f722b2-32a6-4cd6-84e7-c086b76e760c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:25.094807 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b1f722b2-32a6-4cd6-84e7-c086b76e760c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1738 microversion: 2.20 time: 0.294734 Jun 14 19:44:25.103659 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 193/364] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:24 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1738 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:44:25.559181 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-3536cc7f-3c48-4e23-b935-e65f45560f1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:25.561893 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-3536cc7f-3c48-4e23-b935-e65f45560f1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:25.595878 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-86a24f18-d9e0-42e2-9840-40d47eeb5980 req-f7122381-3af9-4d44-bf06-9ac18f494936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e2353fc-c6c0-4c56-8423-5bc7b343acc7", "tag": "90b7f081-458d-4545-b9cc-146a82537268"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:25.604244 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3536cc7f-3c48-4e23-b935-e65f45560f1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:25.607909 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3536cc7f-3c48-4e23-b935-e65f45560f1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:25.615049 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3536cc7f-3c48-4e23-b935-e65f45560f1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:25.615501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3536cc7f-3c48-4e23-b935-e65f45560f1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:25.618520 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-86a24f18-d9e0-42e2-9840-40d47eeb5980 req-f7122381-3af9-4d44-bf06-9ac18f494936 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:25.621858 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-86a24f18-d9e0-42e2-9840-40d47eeb5980 req-f7122381-3af9-4d44-bf06-9ac18f494936 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:25.668823 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-86a24f18-d9e0-42e2-9840-40d47eeb5980 req-f7122381-3af9-4d44-bf06-9ac18f494936 service nova] Creating event network-changed:90b7f081-458d-4545-b9cc-146a82537268 for instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 on hv-cinder-84580 Jun 14 19:44:25.702243 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-86a24f18-d9e0-42e2-9840-40d47eeb5980 req-f7122381-3af9-4d44-bf06-9ac18f494936 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109288 Jun 14 19:44:25.705928 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 194/365] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:44:25.914829 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1a2e337a-7d3e-48b0-a9b5-b6cd796746f1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:25.915865 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1a2e337a-7d3e-48b0-a9b5-b6cd796746f1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:25.949960 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1a2e337a-7d3e-48b0-a9b5-b6cd796746f1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:25.957336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1a2e337a-7d3e-48b0-a9b5-b6cd796746f1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:25.960401 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1a2e337a-7d3e-48b0-a9b5-b6cd796746f1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:25.977360 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1a2e337a-7d3e-48b0-a9b5-b6cd796746f1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:26.326376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-3536cc7f-3c48-4e23-b935-e65f45560f1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:26.347489 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-3536cc7f-3c48-4e23-b935-e65f45560f1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1713 microversion: 2.1 time: 0.813917 Jun 14 19:44:26.349568 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 172/366] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:25 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1713 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:26.355482 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-e4b006a9-e895-4290-b906-4d5febcb8ccb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:26.356876 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-e4b006a9-e895-4290-b906-4d5febcb8ccb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:26.379248 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e4b006a9-e895-4290-b906-4d5febcb8ccb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:26.379954 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e4b006a9-e895-4290-b906-4d5febcb8ccb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:26.381121 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e4b006a9-e895-4290-b906-4d5febcb8ccb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:26.382944 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e4b006a9-e895-4290-b906-4d5febcb8ccb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:26.789331 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1a2e337a-7d3e-48b0-a9b5-b6cd796746f1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:26.825299 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1a2e337a-7d3e-48b0-a9b5-b6cd796746f1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1314 microversion: 2.1 time: 0.915806 Jun 14 19:44:26.826522 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 195/367] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:25 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1314 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:27.145444 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e4b006a9-e895-4290-b906-4d5febcb8ccb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:27.161249 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e4b006a9-e895-4290-b906-4d5febcb8ccb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:27.172645 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e4b006a9-e895-4290-b906-4d5febcb8ccb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:27.176549 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-e4b006a9-e895-4290-b906-4d5febcb8ccb tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1738 microversion: 2.20 time: 0.823539 Jun 14 19:44:27.178615 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 173/368] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:26 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1738 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:27.844538 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e2345851-eaa5-4dcf-bde3-0557b015a445 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:27.845136 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e2345851-eaa5-4dcf-bde3-0557b015a445 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:27.856201 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e2345851-eaa5-4dcf-bde3-0557b015a445 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:27.856882 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e2345851-eaa5-4dcf-bde3-0557b015a445 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:27.857679 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e2345851-eaa5-4dcf-bde3-0557b015a445 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:27.858268 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e2345851-eaa5-4dcf-bde3-0557b015a445 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:28.154037 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-e2345851-eaa5-4dcf-bde3-0557b015a445 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:28.164475 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e2345851-eaa5-4dcf-bde3-0557b015a445 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1369 microversion: 2.1 time: 0.323851 Jun 14 19:44:28.166132 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 196/369] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:27 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1369 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:28.198136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d1caf598-c6ec-4db3-9956-23510a2dac69 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:28.200643 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d1caf598-c6ec-4db3-9956-23510a2dac69 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:28.216106 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d1caf598-c6ec-4db3-9956-23510a2dac69 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:28.233072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d1caf598-c6ec-4db3-9956-23510a2dac69 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:28.245449 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d1caf598-c6ec-4db3-9956-23510a2dac69 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:28.248202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d1caf598-c6ec-4db3-9956-23510a2dac69 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:28.303560 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2013484562", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452"}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:28.451372 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.network.neutron [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] validate_networks() for None {{(pid=124068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:44:28.938811 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Flavor limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:44:28.940559 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Image limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:44:28.941272 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Flavor pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:44:28.941926 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Image pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:44:28.942559 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:44:28.955249 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:28.955927 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:28.956903 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:28.957621 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:28.980258 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Getting quotas for project 34661f0f3c6444e69b48e1a6b55c26d2. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:44:28.985558 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Getting quotas for user 8450ce25e50440ad81c602df61b4bf62 and project 34661f0f3c6444e69b48e1a6b55c26d2. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:44:28.998165 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Going to run 1 instances... {{(pid=124068) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:44:29.000717 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:44:29.048463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=4 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:29.086835 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-548847c4-d1fa-4e71-a2f0-bef69496c7cb tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.786280 Jun 14 19:44:29.088830 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 197/370] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:44:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 14 19:44:29.101629 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9eb66c3d-6b47-4239-bf18-52b98a351a48 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:29.121978 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9eb66c3d-6b47-4239-bf18-52b98a351a48 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:29.273465 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9eb66c3d-6b47-4239-bf18-52b98a351a48 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8450ce25e50440ad81c602df61b4bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34661f0f3c6444e69b48e1a6b55c26d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:29.281774 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9eb66c3d-6b47-4239-bf18-52b98a351a48 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 200 len: 1215 microversion: 2.1 time: 0.187599 Jun 14 19:44:29.283523 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 198/371] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:29 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:29.298706 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d8bdbc2b-9058-487b-83cc-eb81a720960d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:29.300103 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d8bdbc2b-9058-487b-83cc-eb81a720960d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:29.310199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d8bdbc2b-9058-487b-83cc-eb81a720960d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:29.311151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d8bdbc2b-9058-487b-83cc-eb81a720960d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:29.312387 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d8bdbc2b-9058-487b-83cc-eb81a720960d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:29.312932 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d8bdbc2b-9058-487b-83cc-eb81a720960d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:29.329150 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d1caf598-c6ec-4db3-9956-23510a2dac69 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:29.347838 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d1caf598-c6ec-4db3-9956-23510a2dac69 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:29.352363 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d1caf598-c6ec-4db3-9956-23510a2dac69 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:29.354193 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d1caf598-c6ec-4db3-9956-23510a2dac69 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1738 microversion: 2.20 time: 1.161497 Jun 14 19:44:29.354299 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 174/372] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:28 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1738 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:29.582117 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d8bdbc2b-9058-487b-83cc-eb81a720960d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:29.602215 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d8bdbc2b-9058-487b-83cc-eb81a720960d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1369 microversion: 2.1 time: 0.317225 Jun 14 19:44:29.603233 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 199/373] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:29 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1369 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:30.105010 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-8b7561ea-43d8-47c9-9783-d9834beff786 req-cf7a628b-1765-4e54-990b-6ca70bd26441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e845044c-b4e8-462f-abf8-0301476ec285", "tag": "dcc13ad8-c81f-4feb-9c9c-0a5b20e3af4e"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:30.120742 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-8b7561ea-43d8-47c9-9783-d9834beff786 req-cf7a628b-1765-4e54-990b-6ca70bd26441 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:30.127413 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-8b7561ea-43d8-47c9-9783-d9834beff786 req-cf7a628b-1765-4e54-990b-6ca70bd26441 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:30.156391 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-8b7561ea-43d8-47c9-9783-d9834beff786 req-cf7a628b-1765-4e54-990b-6ca70bd26441 service nova] Creating event network-changed:dcc13ad8-c81f-4feb-9c9c-0a5b20e3af4e for instance e845044c-b4e8-462f-abf8-0301476ec285 on hv-cinder-84580 Jun 14 19:44:30.184623 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-8b7561ea-43d8-47c9-9783-d9834beff786 req-cf7a628b-1765-4e54-990b-6ca70bd26441 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085142 Jun 14 19:44:30.185559 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 175/374] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:44:30.306370 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-434742ac-4b0b-4b52-b7e0-ab44dc83a0dc tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:30.307655 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-434742ac-4b0b-4b52-b7e0-ab44dc83a0dc tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:30.316036 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-434742ac-4b0b-4b52-b7e0-ab44dc83a0dc tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:30.323732 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-434742ac-4b0b-4b52-b7e0-ab44dc83a0dc tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:30.324965 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-434742ac-4b0b-4b52-b7e0-ab44dc83a0dc tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:30.325769 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-434742ac-4b0b-4b52-b7e0-ab44dc83a0dc tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:30.387047 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-63d0e360-6697-470d-9345-ef7c72de83dd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:30.387876 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-63d0e360-6697-470d-9345-ef7c72de83dd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:30.414039 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-63d0e360-6697-470d-9345-ef7c72de83dd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:30.414673 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-63d0e360-6697-470d-9345-ef7c72de83dd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:30.415861 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-63d0e360-6697-470d-9345-ef7c72de83dd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:30.416455 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-63d0e360-6697-470d-9345-ef7c72de83dd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:30.431654 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-434742ac-4b0b-4b52-b7e0-ab44dc83a0dc tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8450ce25e50440ad81c602df61b4bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34661f0f3c6444e69b48e1a6b55c26d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:30.442079 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-434742ac-4b0b-4b52-b7e0-ab44dc83a0dc tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 200 len: 1267 microversion: 2.1 time: 0.145797 Jun 14 19:44:30.445588 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 200/375] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:30 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:30.620261 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-fc09c30c-2657-43c2-9839-3db56a9da456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:30.620886 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-fc09c30c-2657-43c2-9839-3db56a9da456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:30.636482 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fc09c30c-2657-43c2-9839-3db56a9da456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:30.636856 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fc09c30c-2657-43c2-9839-3db56a9da456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:30.639686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fc09c30c-2657-43c2-9839-3db56a9da456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:30.640170 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fc09c30c-2657-43c2-9839-3db56a9da456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:30.925356 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-63d0e360-6697-470d-9345-ef7c72de83dd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:30.939351 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-63d0e360-6697-470d-9345-ef7c72de83dd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:30.944112 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-63d0e360-6697-470d-9345-ef7c72de83dd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:30.948571 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-63d0e360-6697-470d-9345-ef7c72de83dd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1738 microversion: 2.20 time: 0.579534 Jun 14 19:44:30.949677 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 176/376] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:30 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1738 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:44:31.237133 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-fc09c30c-2657-43c2-9839-3db56a9da456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:31.251950 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-fc09c30c-2657-43c2-9839-3db56a9da456 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1369 microversion: 2.1 time: 0.635367 Jun 14 19:44:31.254317 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 201/377] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:30 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1369 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:31.464030 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ef1f0f8a-07ba-4813-bfa3-23b57efeac5a tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:31.465312 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ef1f0f8a-07ba-4813-bfa3-23b57efeac5a tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:31.482973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ef1f0f8a-07ba-4813-bfa3-23b57efeac5a tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:31.483663 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ef1f0f8a-07ba-4813-bfa3-23b57efeac5a tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:31.484631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ef1f0f8a-07ba-4813-bfa3-23b57efeac5a tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:31.486508 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ef1f0f8a-07ba-4813-bfa3-23b57efeac5a tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:31.638420 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-ef1f0f8a-07ba-4813-bfa3-23b57efeac5a tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8450ce25e50440ad81c602df61b4bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34661f0f3c6444e69b48e1a6b55c26d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:31.649791 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-ef1f0f8a-07ba-4813-bfa3-23b57efeac5a tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 200 len: 1273 microversion: 2.1 time: 0.193127 Jun 14 19:44:31.651163 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 177/378] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:31 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:31.967769 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-19c2bbac-9fbf-450d-8e3f-b6c782977608 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:31.968379 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-19c2bbac-9fbf-450d-8e3f-b6c782977608 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:31.989529 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-19c2bbac-9fbf-450d-8e3f-b6c782977608 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:31.992210 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-19c2bbac-9fbf-450d-8e3f-b6c782977608 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:31.998845 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-19c2bbac-9fbf-450d-8e3f-b6c782977608 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:31.999640 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-19c2bbac-9fbf-450d-8e3f-b6c782977608 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:32.275372 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-5e484f32-2d99-4c92-9e20-57c829f7c67d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:32.275990 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-5e484f32-2d99-4c92-9e20-57c829f7c67d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:32.305456 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5e484f32-2d99-4c92-9e20-57c829f7c67d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:32.306581 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5e484f32-2d99-4c92-9e20-57c829f7c67d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:32.310981 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5e484f32-2d99-4c92-9e20-57c829f7c67d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:32.311656 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5e484f32-2d99-4c92-9e20-57c829f7c67d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:32.365144 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:32.467164 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-19c2bbac-9fbf-450d-8e3f-b6c782977608 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:32.489340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-19c2bbac-9fbf-450d-8e3f-b6c782977608 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:32.494438 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-19c2bbac-9fbf-450d-8e3f-b6c782977608 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:32.508339 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-19c2bbac-9fbf-450d-8e3f-b6c782977608 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1738 microversion: 2.20 time: 0.539129 Jun 14 19:44:32.508998 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 202/379] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:31 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1738 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:32.673994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4206f5b5-582b-493e-8665-b37c00fc4c15 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:32.676910 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4206f5b5-582b-493e-8665-b37c00fc4c15 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:32.699212 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4206f5b5-582b-493e-8665-b37c00fc4c15 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:32.703139 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4206f5b5-582b-493e-8665-b37c00fc4c15 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:32.704648 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4206f5b5-582b-493e-8665-b37c00fc4c15 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:32.705994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4206f5b5-582b-493e-8665-b37c00fc4c15 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:33.074514 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4206f5b5-582b-493e-8665-b37c00fc4c15 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8450ce25e50440ad81c602df61b4bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34661f0f3c6444e69b48e1a6b55c26d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:33.082441 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4206f5b5-582b-493e-8665-b37c00fc4c15 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 200 len: 1315 microversion: 2.1 time: 0.416926 Jun 14 19:44:33.087299 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 203/380] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:32 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:33.252506 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-5e484f32-2d99-4c92-9e20-57c829f7c67d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:33.265100 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-5e484f32-2d99-4c92-9e20-57c829f7c67d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1369 microversion: 2.1 time: 0.996741 Jun 14 19:44:33.284454 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 178/381] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:32 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1369 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:33.527367 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4b2c8ffb-6fd1-46c8-80f8-606c89081433 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:33.528185 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4b2c8ffb-6fd1-46c8-80f8-606c89081433 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:33.544081 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4b2c8ffb-6fd1-46c8-80f8-606c89081433 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:33.544547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4b2c8ffb-6fd1-46c8-80f8-606c89081433 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:33.553164 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4b2c8ffb-6fd1-46c8-80f8-606c89081433 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:33.553956 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4b2c8ffb-6fd1-46c8-80f8-606c89081433 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:33.641495 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=100 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:34.033354 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4b2c8ffb-6fd1-46c8-80f8-606c89081433 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:34.043726 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4b2c8ffb-6fd1-46c8-80f8-606c89081433 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:34.045252 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4b2c8ffb-6fd1-46c8-80f8-606c89081433 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:34.055059 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4b2c8ffb-6fd1-46c8-80f8-606c89081433 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1738 microversion: 2.20 time: 0.523321 Jun 14 19:44:34.055829 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 204/382] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:33 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1738 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:34.106547 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1e65bb1e-3ce6-44e9-946e-74b522b8f198 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:34.107514 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-1e65bb1e-3ce6-44e9-946e-74b522b8f198 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:34.122612 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1e65bb1e-3ce6-44e9-946e-74b522b8f198 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:34.125931 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1e65bb1e-3ce6-44e9-946e-74b522b8f198 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:34.128608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1e65bb1e-3ce6-44e9-946e-74b522b8f198 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:34.129295 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1e65bb1e-3ce6-44e9-946e-74b522b8f198 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:34.245244 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-5725f0c5-2d61-4379-9c49-0ea09efb8227 req-b19a3e7d-8ba6-421c-8241-6fca55c32ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ece98ca-4dfc-4e24-a4d3-0b99f392d31c", "tag": "6740ecea-b958-44ec-827a-4303f11ba392"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:34.261752 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-5725f0c5-2d61-4379-9c49-0ea09efb8227 req-b19a3e7d-8ba6-421c-8241-6fca55c32ebe service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:34.262609 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-5725f0c5-2d61-4379-9c49-0ea09efb8227 req-b19a3e7d-8ba6-421c-8241-6fca55c32ebe service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:34.297782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-5725f0c5-2d61-4379-9c49-0ea09efb8227 req-b19a3e7d-8ba6-421c-8241-6fca55c32ebe service nova] Creating event network-changed:6740ecea-b958-44ec-827a-4303f11ba392 for instance 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c on hv-cinder-84580 Jun 14 19:44:34.307193 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-5725f0c5-2d61-4379-9c49-0ea09efb8227 req-b19a3e7d-8ba6-421c-8241-6fca55c32ebe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071418 Jun 14 19:44:34.309689 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 205/383] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:44:34.324456 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f1f0d8ea-61ca-4353-9de4-4717abe63eb6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:34.325267 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f1f0d8ea-61ca-4353-9de4-4717abe63eb6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:34.357858 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1f0d8ea-61ca-4353-9de4-4717abe63eb6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:34.360695 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1f0d8ea-61ca-4353-9de4-4717abe63eb6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:34.363495 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1f0d8ea-61ca-4353-9de4-4717abe63eb6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:34.364122 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1f0d8ea-61ca-4353-9de4-4717abe63eb6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:34.727178 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-1e65bb1e-3ce6-44e9-946e-74b522b8f198 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8450ce25e50440ad81c602df61b4bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34661f0f3c6444e69b48e1a6b55c26d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:34.744361 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-1e65bb1e-3ce6-44e9-946e-74b522b8f198 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 200 len: 1315 microversion: 2.1 time: 0.643107 Jun 14 19:44:34.745870 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 179/384] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:34 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:34.799974 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-f1f0d8ea-61ca-4353-9de4-4717abe63eb6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:34.829580 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f1f0d8ea-61ca-4353-9de4-4717abe63eb6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1369 microversion: 2.1 time: 0.516738 Jun 14 19:44:34.844879 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 206/385] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:34 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1369 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:35.075867 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-15f12469-743e-4b09-b7be-485448caabe1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:35.076871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-15f12469-743e-4b09-b7be-485448caabe1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:35.086807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-15f12469-743e-4b09-b7be-485448caabe1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:35.094040 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-15f12469-743e-4b09-b7be-485448caabe1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:35.097831 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-15f12469-743e-4b09-b7be-485448caabe1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:35.099038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-15f12469-743e-4b09-b7be-485448caabe1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:35.363062 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-15f12469-743e-4b09-b7be-485448caabe1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:35.372619 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-15f12469-743e-4b09-b7be-485448caabe1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:35.375415 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-15f12469-743e-4b09-b7be-485448caabe1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:35.377208 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-15f12469-743e-4b09-b7be-485448caabe1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1738 microversion: 2.20 time: 0.305169 Jun 14 19:44:35.402168 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 180/386] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:35 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:35.763228 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-023a3f52-222e-464c-92df-45ae408a8295 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:35.763943 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-023a3f52-222e-464c-92df-45ae408a8295 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:35.772575 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-023a3f52-222e-464c-92df-45ae408a8295 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:35.773107 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-023a3f52-222e-464c-92df-45ae408a8295 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:35.774044 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-023a3f52-222e-464c-92df-45ae408a8295 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:35.774581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-023a3f52-222e-464c-92df-45ae408a8295 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:35.847323 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-43cc2d00-872b-455a-85ba-9591175e342a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:35.847932 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-43cc2d00-872b-455a-85ba-9591175e342a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:35.856486 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-43cc2d00-872b-455a-85ba-9591175e342a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:35.857610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-43cc2d00-872b-455a-85ba-9591175e342a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:35.858972 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-43cc2d00-872b-455a-85ba-9591175e342a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:35.859715 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-43cc2d00-872b-455a-85ba-9591175e342a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:35.967588 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-023a3f52-222e-464c-92df-45ae408a8295 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8450ce25e50440ad81c602df61b4bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34661f0f3c6444e69b48e1a6b55c26d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:35.981833 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-023a3f52-222e-464c-92df-45ae408a8295 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 200 len: 1315 microversion: 2.1 time: 0.220742 Jun 14 19:44:35.983398 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 207/387] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:35 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:35.988776 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-e2db6ae7-504a-4835-93e8-6e00a216d476 req-1f7d6347-ebc6-49c8-9bb0-18c51374db17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e845044c-b4e8-462f-abf8-0301476ec285", "name": "network-vif-plugged", "status": "completed", "tag": "dcc13ad8-c81f-4feb-9c9c-0a5b20e3af4e"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:36.000159 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-e2db6ae7-504a-4835-93e8-6e00a216d476 req-1f7d6347-ebc6-49c8-9bb0-18c51374db17 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:36.000604 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-e2db6ae7-504a-4835-93e8-6e00a216d476 req-1f7d6347-ebc6-49c8-9bb0-18c51374db17 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:36.015771 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-e2db6ae7-504a-4835-93e8-6e00a216d476 req-1f7d6347-ebc6-49c8-9bb0-18c51374db17 service nova] Creating event network-vif-plugged:dcc13ad8-c81f-4feb-9c9c-0a5b20e3af4e for instance e845044c-b4e8-462f-abf8-0301476ec285 on hv-cinder-84580 Jun 14 19:44:36.022283 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-e2db6ae7-504a-4835-93e8-6e00a216d476 req-1f7d6347-ebc6-49c8-9bb0-18c51374db17 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037159 Jun 14 19:44:36.023019 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 208/388] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:44:36.079291 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-43cc2d00-872b-455a-85ba-9591175e342a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:36.088574 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-43cc2d00-872b-455a-85ba-9591175e342a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1369 microversion: 2.1 time: 0.244293 Jun 14 19:44:36.090059 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 181/389] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:35 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1369 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:36.400660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-84fa3371-38ae-41ba-a55b-78beb052a3ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:36.401410 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-84fa3371-38ae-41ba-a55b-78beb052a3ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:36.410711 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-84fa3371-38ae-41ba-a55b-78beb052a3ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:36.411165 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-84fa3371-38ae-41ba-a55b-78beb052a3ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:36.411957 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-84fa3371-38ae-41ba-a55b-78beb052a3ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:36.413080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-84fa3371-38ae-41ba-a55b-78beb052a3ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:36.736526 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-84fa3371-38ae-41ba-a55b-78beb052a3ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:36.749707 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-84fa3371-38ae-41ba-a55b-78beb052a3ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:36.751211 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-84fa3371-38ae-41ba-a55b-78beb052a3ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:36.752613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-84fa3371-38ae-41ba-a55b-78beb052a3ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1738 microversion: 2.20 time: 0.359895 Jun 14 19:44:36.766862 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 209/390] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:36 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1738 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:37.003043 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d6eba83f-0f55-463e-b100-d8c90ade826b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:37.005312 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d6eba83f-0f55-463e-b100-d8c90ade826b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:37.019144 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d6eba83f-0f55-463e-b100-d8c90ade826b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:37.019837 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d6eba83f-0f55-463e-b100-d8c90ade826b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:37.021330 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d6eba83f-0f55-463e-b100-d8c90ade826b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:37.022928 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d6eba83f-0f55-463e-b100-d8c90ade826b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:37.108274 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d5cd84e8-8abf-4265-925e-4b03b8b60b03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:37.109739 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d5cd84e8-8abf-4265-925e-4b03b8b60b03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:37.118717 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d5cd84e8-8abf-4265-925e-4b03b8b60b03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:37.120445 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d5cd84e8-8abf-4265-925e-4b03b8b60b03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:37.122025 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d5cd84e8-8abf-4265-925e-4b03b8b60b03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:37.122687 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d5cd84e8-8abf-4265-925e-4b03b8b60b03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:37.361123 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d5cd84e8-8abf-4265-925e-4b03b8b60b03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:37.376197 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d5cd84e8-8abf-4265-925e-4b03b8b60b03 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1369 microversion: 2.1 time: 0.272695 Jun 14 19:44:37.379119 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 210/391] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:37 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1369 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:37.452716 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d6eba83f-0f55-463e-b100-d8c90ade826b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8450ce25e50440ad81c602df61b4bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34661f0f3c6444e69b48e1a6b55c26d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:37.462210 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d6eba83f-0f55-463e-b100-d8c90ade826b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 200 len: 1315 microversion: 2.1 time: 0.465952 Jun 14 19:44:37.478497 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 182/392] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:36 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:37.772675 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-eb490a86-9315-4504-80b2-4511e146241c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:37.774093 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-eb490a86-9315-4504-80b2-4511e146241c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:37.793937 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-eb490a86-9315-4504-80b2-4511e146241c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:37.794835 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-eb490a86-9315-4504-80b2-4511e146241c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:37.817926 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-eb490a86-9315-4504-80b2-4511e146241c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:37.821469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-eb490a86-9315-4504-80b2-4511e146241c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:38.169624 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-eb490a86-9315-4504-80b2-4511e146241c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:38.188518 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-eb490a86-9315-4504-80b2-4511e146241c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:38.191640 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-eb490a86-9315-4504-80b2-4511e146241c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:38.194461 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-eb490a86-9315-4504-80b2-4511e146241c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1720 microversion: 2.20 time: 0.425538 Jun 14 19:44:38.195620 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 211/393] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:37 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1720 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:38.396181 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9e9d3a67-db5d-49d1-ac0e-efedb1342270 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:38.397866 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9e9d3a67-db5d-49d1-ac0e-efedb1342270 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:38.415044 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9e9d3a67-db5d-49d1-ac0e-efedb1342270 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:38.415830 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9e9d3a67-db5d-49d1-ac0e-efedb1342270 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:38.426251 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9e9d3a67-db5d-49d1-ac0e-efedb1342270 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:38.427127 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9e9d3a67-db5d-49d1-ac0e-efedb1342270 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:38.480546 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-15f28059-43b6-43f3-b901-9260e7395968 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:38.481152 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-15f28059-43b6-43f3-b901-9260e7395968 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:38.487520 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-15f28059-43b6-43f3-b901-9260e7395968 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:38.488446 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-15f28059-43b6-43f3-b901-9260e7395968 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:38.490098 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-15f28059-43b6-43f3-b901-9260e7395968 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:38.492064 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-15f28059-43b6-43f3-b901-9260e7395968 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:38.733122 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-15f28059-43b6-43f3-b901-9260e7395968 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8450ce25e50440ad81c602df61b4bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34661f0f3c6444e69b48e1a6b55c26d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:38.739386 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9e9d3a67-db5d-49d1-ac0e-efedb1342270 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:38.745895 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-15f28059-43b6-43f3-b901-9260e7395968 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 200 len: 1315 microversion: 2.1 time: 0.269118 Jun 14 19:44:38.749185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9e9d3a67-db5d-49d1-ac0e-efedb1342270 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1369 microversion: 2.1 time: 0.358205 Jun 14 19:44:38.760229 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 212/394] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:38 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:38.763676 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 183/395] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:38 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1369 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:39.213472 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-857dda7a-11f9-47ed-a451-d9133db97f4f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:39.214006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-857dda7a-11f9-47ed-a451-d9133db97f4f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:39.217317 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=4 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:39.221961 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-857dda7a-11f9-47ed-a451-d9133db97f4f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:39.222428 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-857dda7a-11f9-47ed-a451-d9133db97f4f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:39.223180 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-857dda7a-11f9-47ed-a451-d9133db97f4f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:39.223613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-857dda7a-11f9-47ed-a451-d9133db97f4f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:39.281283 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=16 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:39.372908 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-857dda7a-11f9-47ed-a451-d9133db97f4f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:39.389449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-857dda7a-11f9-47ed-a451-d9133db97f4f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:39.391109 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-857dda7a-11f9-47ed-a451-d9133db97f4f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:39.392744 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-857dda7a-11f9-47ed-a451-d9133db97f4f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1720 microversion: 2.20 time: 0.183932 Jun 14 19:44:39.395877 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 213/396] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:39 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:39.766442 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a4d806ae-9456-41e7-8d69-532117f71326 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:39.767715 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a4d806ae-9456-41e7-8d69-532117f71326 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:39.772686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-33097d4f-be53-4af6-ad90-e90ae1c5f2de tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:39.773313 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-33097d4f-be53-4af6-ad90-e90ae1c5f2de tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:39.776824 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a4d806ae-9456-41e7-8d69-532117f71326 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:39.778188 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a4d806ae-9456-41e7-8d69-532117f71326 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:39.779461 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a4d806ae-9456-41e7-8d69-532117f71326 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:39.780221 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a4d806ae-9456-41e7-8d69-532117f71326 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:39.789992 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-33097d4f-be53-4af6-ad90-e90ae1c5f2de tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:39.790457 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-33097d4f-be53-4af6-ad90-e90ae1c5f2de tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:39.791461 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-33097d4f-be53-4af6-ad90-e90ae1c5f2de tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:39.791939 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-33097d4f-be53-4af6-ad90-e90ae1c5f2de tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:40.008162 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a4d806ae-9456-41e7-8d69-532117f71326 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8450ce25e50440ad81c602df61b4bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34661f0f3c6444e69b48e1a6b55c26d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:40.020313 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a4d806ae-9456-41e7-8d69-532117f71326 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 200 len: 1315 microversion: 2.1 time: 0.258826 Jun 14 19:44:40.023249 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 184/397] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:39 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:40.062732 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-33097d4f-be53-4af6-ad90-e90ae1c5f2de tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:40.078944 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-33097d4f-be53-4af6-ad90-e90ae1c5f2de tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1561 microversion: 2.1 time: 0.311083 Jun 14 19:44:40.080707 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 214/398] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:39 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1561 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:40.096145 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a6122563-4f2a-4aaa-86a4-eca45a79fb39 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:40.097002 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a6122563-4f2a-4aaa-86a4-eca45a79fb39 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:40.104924 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a6122563-4f2a-4aaa-86a4-eca45a79fb39 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:40.105911 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a6122563-4f2a-4aaa-86a4-eca45a79fb39 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:40.106918 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a6122563-4f2a-4aaa-86a4-eca45a79fb39 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:40.107607 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a6122563-4f2a-4aaa-86a4-eca45a79fb39 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:40.202670 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a6122563-4f2a-4aaa-86a4-eca45a79fb39 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110509 Jun 14 19:44:40.209876 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 185/399] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 14 19:44:40 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:44:40.416949 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a046fce2-6133-44d2-8771-3cae55203492 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:40.419628 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a046fce2-6133-44d2-8771-3cae55203492 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:40.435945 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a046fce2-6133-44d2-8771-3cae55203492 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:40.436803 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a046fce2-6133-44d2-8771-3cae55203492 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:40.437858 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a046fce2-6133-44d2-8771-3cae55203492 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:40.438622 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a046fce2-6133-44d2-8771-3cae55203492 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:40.604542 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-5e40df19-3b4f-48e0-82ed-1330746c9f76 req-cb78032a-3c6d-4004-b132-7fb614aa4f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ece98ca-4dfc-4e24-a4d3-0b99f392d31c", "name": "network-vif-plugged", "status": "completed", "tag": "6740ecea-b958-44ec-827a-4303f11ba392"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:40.627983 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-5e40df19-3b4f-48e0-82ed-1330746c9f76 req-cb78032a-3c6d-4004-b132-7fb614aa4f9c service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:40.628490 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-5e40df19-3b4f-48e0-82ed-1330746c9f76 req-cb78032a-3c6d-4004-b132-7fb614aa4f9c service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:40.643296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-5e40df19-3b4f-48e0-82ed-1330746c9f76 req-cb78032a-3c6d-4004-b132-7fb614aa4f9c service nova] Creating event network-vif-plugged:6740ecea-b958-44ec-827a-4303f11ba392 for instance 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c on hv-cinder-84580 Jun 14 19:44:40.658021 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-5e40df19-3b4f-48e0-82ed-1330746c9f76 req-cb78032a-3c6d-4004-b132-7fb614aa4f9c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057960 Jun 14 19:44:40.659918 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 186/400] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:44:40.723871 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a046fce2-6133-44d2-8771-3cae55203492 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:40.745980 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a046fce2-6133-44d2-8771-3cae55203492 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:40.747790 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a046fce2-6133-44d2-8771-3cae55203492 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:40.752571 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a046fce2-6133-44d2-8771-3cae55203492 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1720 microversion: 2.20 time: 0.343131 Jun 14 19:44:40.753745 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 215/401] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:40 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1720 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:41.054002 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8cf5ce7f-c323-4309-bc38-ea3f406dd365 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:41.055334 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8cf5ce7f-c323-4309-bc38-ea3f406dd365 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:41.063721 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8cf5ce7f-c323-4309-bc38-ea3f406dd365 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:41.064478 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8cf5ce7f-c323-4309-bc38-ea3f406dd365 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:41.065839 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8cf5ce7f-c323-4309-bc38-ea3f406dd365 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:41.066486 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8cf5ce7f-c323-4309-bc38-ea3f406dd365 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:41.681631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8cf5ce7f-c323-4309-bc38-ea3f406dd365 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8450ce25e50440ad81c602df61b4bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34661f0f3c6444e69b48e1a6b55c26d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:41.690029 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8cf5ce7f-c323-4309-bc38-ea3f406dd365 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 200 len: 1315 microversion: 2.1 time: 0.655503 Jun 14 19:44:41.692710 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 187/402] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:41 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 1315 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:41.772047 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-416d5007-55d3-445d-868a-3dfc6f5cc939 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:41.774305 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-416d5007-55d3-445d-868a-3dfc6f5cc939 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:41.781751 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-416d5007-55d3-445d-868a-3dfc6f5cc939 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:41.782403 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-416d5007-55d3-445d-868a-3dfc6f5cc939 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:41.783280 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-416d5007-55d3-445d-868a-3dfc6f5cc939 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:41.786202 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-416d5007-55d3-445d-868a-3dfc6f5cc939 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:42.026876 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-a4d6adc0-4967-4737-96a0-1b410ae57e76 req-b4d8c622-e26a-4b68-b31a-46a8a9e11dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e845044c-b4e8-462f-abf8-0301476ec285", "tag": "dcc13ad8-c81f-4feb-9c9c-0a5b20e3af4e"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:42.045320 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-a4d6adc0-4967-4737-96a0-1b410ae57e76 req-b4d8c622-e26a-4b68-b31a-46a8a9e11dbc service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:42.046128 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-a4d6adc0-4967-4737-96a0-1b410ae57e76 req-b4d8c622-e26a-4b68-b31a-46a8a9e11dbc service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:42.071344 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-a4d6adc0-4967-4737-96a0-1b410ae57e76 req-b4d8c622-e26a-4b68-b31a-46a8a9e11dbc service nova] Creating event network-changed:dcc13ad8-c81f-4feb-9c9c-0a5b20e3af4e for instance e845044c-b4e8-462f-abf8-0301476ec285 on hv-cinder-84580 Jun 14 19:44:42.082004 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-a4d6adc0-4967-4737-96a0-1b410ae57e76 req-b4d8c622-e26a-4b68-b31a-46a8a9e11dbc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058782 Jun 14 19:44:42.083225 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 188/403] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:44:42.132948 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-416d5007-55d3-445d-868a-3dfc6f5cc939 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:42.147082 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-416d5007-55d3-445d-868a-3dfc6f5cc939 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:42.149149 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-416d5007-55d3-445d-868a-3dfc6f5cc939 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:42.150494 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-416d5007-55d3-445d-868a-3dfc6f5cc939 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1663 microversion: 2.20 time: 0.383072 Jun 14 19:44:42.151049 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 216/404] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:41 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1663 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:42.171330 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6e7cdfcf-d7c6-423e-93b3-2af543a7286e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26de5fd8-5c85-457c-996b-2c1ea3df2e92"}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:42.172790 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-6e7cdfcf-d7c6-423e-93b3-2af543a7286e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:42.181356 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6e7cdfcf-d7c6-423e-93b3-2af543a7286e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:42.182415 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6e7cdfcf-d7c6-423e-93b3-2af543a7286e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:42.184456 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6e7cdfcf-d7c6-423e-93b3-2af543a7286e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:42.185128 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6e7cdfcf-d7c6-423e-93b3-2af543a7286e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:42.527749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-fd7a8a23-14c5-487f-8800-0bf16930adf4 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Action: 'create', calling method: .version_select at 0x7f144af9f9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1117510646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5YdojTuFdOcjnomeTilgBGaKapAUeJ2B+xwKbVwvaq2pWcETnKctKeWEwAveiJiObiJkg/wqmLUfJOozkgMRm9ctBobDcbS0A2BqTnk3B8u3bCfdgrfBflstQR1T4m+A=="}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:42.536841 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:42.544629 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-fd7a8a23-14c5-487f-8800-0bf16930adf4 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Getting quotas for project 780be61f7cb0429fbd97488f41a6b644. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:44:42.549710 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-fd7a8a23-14c5-487f-8800-0bf16930adf4 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Getting quotas for user 7a5fb1cff46d4e3e8e23f9a788cec9ed and project 780be61f7cb0429fbd97488f41a6b644. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:44:42.575235 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-fd7a8a23-14c5-487f-8800-0bf16930adf4 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.277161 Jun 14 19:44:42.576334 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 217/405] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 14 19:44:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:44:42.592811 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6e7cdfcf-d7c6-423e-93b3-2af543a7286e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "POST /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.427142 Jun 14 19:44:42.598610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 189/406] 10.222.0.44 () {62 vars in 1363 bytes} [Tue Jun 14 19:44:42 2022] POST /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/os-volume_attachments => generated 188 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:44:42.693185 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-9d4ea0d8-53b3-477c-acef-d37a08f7235b req-5ddf020c-b986-45b3-bdfe-c646167e028b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2d9ed3-941a-496c-b3c8-a9a5648cd846", "name": "network-vif-unplugged", "status": "completed", "tag": "5445a8aa-6257-4a17-8a1b-eff254fa9a9d"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:42.708049 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-9d4ea0d8-53b3-477c-acef-d37a08f7235b req-5ddf020c-b986-45b3-bdfe-c646167e028b service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:42.709932 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-9d4ea0d8-53b3-477c-acef-d37a08f7235b req-5ddf020c-b986-45b3-bdfe-c646167e028b service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:42.711172 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8bb13548-4a9f-4fb8-a81a-ae83d6a06250 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:42.711901 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8bb13548-4a9f-4fb8-a81a-ae83d6a06250 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:42.722320 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8bb13548-4a9f-4fb8-a81a-ae83d6a06250 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:42.725836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8bb13548-4a9f-4fb8-a81a-ae83d6a06250 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:42.727072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8bb13548-4a9f-4fb8-a81a-ae83d6a06250 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:42.728897 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8bb13548-4a9f-4fb8-a81a-ae83d6a06250 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:42.743298 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.compute.server_external_events [req-9d4ea0d8-53b3-477c-acef-d37a08f7235b req-5ddf020c-b986-45b3-bdfe-c646167e028b service nova] Unable to find a host for instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846. Dropping event network-vif-unplugged {{(pid=124068) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 14 19:44:42.744624 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-9d4ea0d8-53b3-477c-acef-d37a08f7235b req-5ddf020c-b986-45b3-bdfe-c646167e028b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.056772 Jun 14 19:44:42.746570 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 218/407] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 14 19:44:42.781260 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f6e26454-aea7-439a-a4e8-2443da31a827 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:42.783454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f6e26454-aea7-439a-a4e8-2443da31a827 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:42.793696 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f6e26454-aea7-439a-a4e8-2443da31a827 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:42.795133 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f6e26454-aea7-439a-a4e8-2443da31a827 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:42.796126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f6e26454-aea7-439a-a4e8-2443da31a827 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:42.796717 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f6e26454-aea7-439a-a4e8-2443da31a827 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:43.029546 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f6e26454-aea7-439a-a4e8-2443da31a827 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "POST /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/action" status: 202 len: 0 microversion: 2.20 time: 0.250171 Jun 14 19:44:43.033326 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 219/408] 10.222.0.44 () {62 vars in 1318 bytes} [Tue Jun 14 19:44:42 2022] POST /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 14 19:44:43.038992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8bb13548-4a9f-4fb8-a81a-ae83d6a06250 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8450ce25e50440ad81c602df61b4bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34661f0f3c6444e69b48e1a6b55c26d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:43.051008 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-2fa455e6-3714-4e69-8ea8-cd33279c5f7e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:43.053992 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-2fa455e6-3714-4e69-8ea8-cd33279c5f7e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:43.055662 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8bb13548-4a9f-4fb8-a81a-ae83d6a06250 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 200 len: 1315 microversion: 2.1 time: 0.351334 Jun 14 19:44:43.056266 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 190/409] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:42 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:43.072730 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2fa455e6-3714-4e69-8ea8-cd33279c5f7e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:43.073307 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2fa455e6-3714-4e69-8ea8-cd33279c5f7e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:43.074977 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2fa455e6-3714-4e69-8ea8-cd33279c5f7e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:43.076149 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2fa455e6-3714-4e69-8ea8-cd33279c5f7e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:43.332047 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-2fa455e6-3714-4e69-8ea8-cd33279c5f7e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:43.342336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-2fa455e6-3714-4e69-8ea8-cd33279c5f7e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:43.345483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-2fa455e6-3714-4e69-8ea8-cd33279c5f7e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:43.347169 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-2fa455e6-3714-4e69-8ea8-cd33279c5f7e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1749 microversion: 2.20 time: 0.311597 Jun 14 19:44:43.348096 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 220/410] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:43 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1749 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:44:44.076745 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c6bfbf4f-26b3-48b0-8242-605d33b876f0 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:44.077584 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c6bfbf4f-26b3-48b0-8242-605d33b876f0 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:44.089266 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c6bfbf4f-26b3-48b0-8242-605d33b876f0 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:44.091455 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c6bfbf4f-26b3-48b0-8242-605d33b876f0 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:44.092391 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c6bfbf4f-26b3-48b0-8242-605d33b876f0 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:44.093890 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c6bfbf4f-26b3-48b0-8242-605d33b876f0 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:44.357947 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c6bfbf4f-26b3-48b0-8242-605d33b876f0 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8450ce25e50440ad81c602df61b4bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34661f0f3c6444e69b48e1a6b55c26d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:44.366833 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-5d74f12d-585d-4d22-832a-6bdbc04724a8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:44.368019 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-5d74f12d-585d-4d22-832a-6bdbc04724a8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:44.382390 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c6bfbf4f-26b3-48b0-8242-605d33b876f0 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 200 len: 1464 microversion: 2.1 time: 0.310723 Jun 14 19:44:44.387826 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5d74f12d-585d-4d22-832a-6bdbc04724a8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:44.388279 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5d74f12d-585d-4d22-832a-6bdbc04724a8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:44.389053 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5d74f12d-585d-4d22-832a-6bdbc04724a8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:44.389515 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5d74f12d-585d-4d22-832a-6bdbc04724a8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:44.400088 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 191/411] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:44 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 1464 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:44.459482 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-75eff621-b900-4951-b5b1-e86f6c914167 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:44.460344 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-75eff621-b900-4951-b5b1-e86f6c914167 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:44.468901 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-75eff621-b900-4951-b5b1-e86f6c914167 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:44.471209 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-75eff621-b900-4951-b5b1-e86f6c914167 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:44.472201 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-75eff621-b900-4951-b5b1-e86f6c914167 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:44.477636 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-75eff621-b900-4951-b5b1-e86f6c914167 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:44.512223 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-75eff621-b900-4951-b5b1-e86f6c914167 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Going to try to terminate instance {{(pid=124069) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:44:44.557612 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:44.623909 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-75eff621-b900-4951-b5b1-e86f6c914167 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 204 len: 0 microversion: 2.1 time: 0.168640 Jun 14 19:44:44.624792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 192/412] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:44:44 2022] DELETE /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 14 19:44:44.639307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8a9a2b6c-b3b4-4e49-93ed-e25eeb3b5608 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:44.640337 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8a9a2b6c-b3b4-4e49-93ed-e25eeb3b5608 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:44.648729 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8a9a2b6c-b3b4-4e49-93ed-e25eeb3b5608 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:44.649511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8a9a2b6c-b3b4-4e49-93ed-e25eeb3b5608 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:44.650515 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8a9a2b6c-b3b4-4e49-93ed-e25eeb3b5608 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:44.650958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8a9a2b6c-b3b4-4e49-93ed-e25eeb3b5608 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:44.744741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-5d74f12d-585d-4d22-832a-6bdbc04724a8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:44.757779 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-5d74f12d-585d-4d22-832a-6bdbc04724a8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:44.759668 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-5d74f12d-585d-4d22-832a-6bdbc04724a8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:44.761057 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-5d74f12d-585d-4d22-832a-6bdbc04724a8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1749 microversion: 2.20 time: 0.398346 Jun 14 19:44:44.761835 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 221/413] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:44 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1749 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:44:44.853414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8a9a2b6c-b3b4-4e49-93ed-e25eeb3b5608 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8450ce25e50440ad81c602df61b4bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34661f0f3c6444e69b48e1a6b55c26d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:44.862643 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8a9a2b6c-b3b4-4e49-93ed-e25eeb3b5608 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 200 len: 1470 microversion: 2.1 time: 0.231147 Jun 14 19:44:44.863907 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 193/414] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:44 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 1470 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:44:45.779749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b68b18c3-6f91-4357-9d1d-f78727248c6b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:45.780651 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b68b18c3-6f91-4357-9d1d-f78727248c6b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:45.787964 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b68b18c3-6f91-4357-9d1d-f78727248c6b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:45.788249 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b68b18c3-6f91-4357-9d1d-f78727248c6b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:45.788877 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b68b18c3-6f91-4357-9d1d-f78727248c6b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:45.789313 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b68b18c3-6f91-4357-9d1d-f78727248c6b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:45.882309 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c25feec3-07d1-4720-9b29-9639933f414b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:45.882918 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c25feec3-07d1-4720-9b29-9639933f414b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:45.889958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c25feec3-07d1-4720-9b29-9639933f414b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:45.890653 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c25feec3-07d1-4720-9b29-9639933f414b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:45.891693 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c25feec3-07d1-4720-9b29-9639933f414b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:45.892287 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c25feec3-07d1-4720-9b29-9639933f414b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:45.966040 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b68b18c3-6f91-4357-9d1d-f78727248c6b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:45.968220 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:45.980492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b68b18c3-6f91-4357-9d1d-f78727248c6b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:45.982124 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b68b18c3-6f91-4357-9d1d-f78727248c6b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:45.983336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b68b18c3-6f91-4357-9d1d-f78727248c6b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1751 microversion: 2.20 time: 0.207704 Jun 14 19:44:45.995346 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 222/415] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:45 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1751 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:46.062019 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c25feec3-07d1-4720-9b29-9639933f414b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8450ce25e50440ad81c602df61b4bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34661f0f3c6444e69b48e1a6b55c26d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:46.074558 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c25feec3-07d1-4720-9b29-9639933f414b tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 200 len: 1470 microversion: 2.1 time: 0.196992 Jun 14 19:44:46.075412 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 194/416] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:45 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 1470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:47.002980 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d6176fd5-1698-4042-b66a-690892e1156b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:47.003885 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d6176fd5-1698-4042-b66a-690892e1156b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:47.015527 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d6176fd5-1698-4042-b66a-690892e1156b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:47.016101 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d6176fd5-1698-4042-b66a-690892e1156b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:47.017063 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d6176fd5-1698-4042-b66a-690892e1156b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:47.017620 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d6176fd5-1698-4042-b66a-690892e1156b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:47.023458 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-7559726a-42b5-47dc-a0f8-380379899ae7 req-aa61cf28-336c-4804-864a-80e18849e9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ece98ca-4dfc-4e24-a4d3-0b99f392d31c", "name": "network-vif-deleted", "tag": "6740ecea-b958-44ec-827a-4303f11ba392"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:44:47.027689 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:47.038617 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-7559726a-42b5-47dc-a0f8-380379899ae7 req-aa61cf28-336c-4804-864a-80e18849e9bb service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:47.039081 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-7559726a-42b5-47dc-a0f8-380379899ae7 req-aa61cf28-336c-4804-864a-80e18849e9bb service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:47.050850 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-7559726a-42b5-47dc-a0f8-380379899ae7 req-aa61cf28-336c-4804-864a-80e18849e9bb service nova] Creating event network-vif-deleted:6740ecea-b958-44ec-827a-4303f11ba392 for instance 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c on hv-cinder-84580 Jun 14 19:44:47.056433 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-7559726a-42b5-47dc-a0f8-380379899ae7 req-aa61cf28-336c-4804-864a-80e18849e9bb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036632 Jun 14 19:44:47.057224 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 195/417] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:44:47.095216 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2cd69321-f972-4192-a681-9e6b2fbaab13 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:47.096183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2cd69321-f972-4192-a681-9e6b2fbaab13 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:47.103373 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2cd69321-f972-4192-a681-9e6b2fbaab13 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:47.103820 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2cd69321-f972-4192-a681-9e6b2fbaab13 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:47.104781 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2cd69321-f972-4192-a681-9e6b2fbaab13 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:47.105739 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2cd69321-f972-4192-a681-9e6b2fbaab13 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:47.172568 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d6176fd5-1698-4042-b66a-690892e1156b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:47.180193 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2cd69321-f972-4192-a681-9e6b2fbaab13 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8450ce25e50440ad81c602df61b4bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34661f0f3c6444e69b48e1a6b55c26d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:47.182537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d6176fd5-1698-4042-b66a-690892e1156b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:47.185005 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d6176fd5-1698-4042-b66a-690892e1156b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:47.186340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d6176fd5-1698-4042-b66a-690892e1156b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.187657 Jun 14 19:44:47.186897 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 223/418] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:46 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:47.188083 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2cd69321-f972-4192-a681-9e6b2fbaab13 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 200 len: 1428 microversion: 2.1 time: 0.099443 Jun 14 19:44:47.193189 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 196/419] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:47 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 1428 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:44:48.205236 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-fe372e81-f3a7-482a-b43d-dcaad454b473 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:48.205886 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-fe372e81-f3a7-482a-b43d-dcaad454b473 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] [instance: 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:48.212348 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-dce6d930-7c41-470f-9bb2-643b040d9528 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:48.213588 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-dce6d930-7c41-470f-9bb2-643b040d9528 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:48.215450 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fe372e81-f3a7-482a-b43d-dcaad454b473 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:48.216327 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fe372e81-f3a7-482a-b43d-dcaad454b473 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:48.217261 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fe372e81-f3a7-482a-b43d-dcaad454b473 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:48.218156 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fe372e81-f3a7-482a-b43d-dcaad454b473 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:48.220969 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dce6d930-7c41-470f-9bb2-643b040d9528 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:48.221642 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dce6d930-7c41-470f-9bb2-643b040d9528 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:48.222704 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dce6d930-7c41-470f-9bb2-643b040d9528 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:48.223346 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dce6d930-7c41-470f-9bb2-643b040d9528 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:48.236873 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-fe372e81-f3a7-482a-b43d-dcaad454b473 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] HTTP exception thrown: Instance 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c could not be found. Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-fe372e81-f3a7-482a-b43d-dcaad454b473 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Request method failure captured: Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c HTTP/1.1 Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOUZV7xatd-RzkPeSp8SpbCPSfVmqkN7Z4-5eP_aD39DBT2z6j83WY986jxR6IK2USmKQhcHEk1hgFrGp876KJiHwBvr8A8-1etgoqzX23PQfCeZfwatPOnt3JBTrp9mHAKLJtxHpeN9Uqt_gUdgmfy1gG68H_u_NtvNgaKyOKFoOi0 Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: 34661f0f3c6444e69b48e1a6b55c26d2 Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-VolumesNegativeTest-246763973 Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:44:48.238610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:44:48.239920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34661f0f3c6444e69b48e1a6b55c26d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34661f0f3c6444e69b48e1a6b55c26d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34661f0f3c6444e69b48e1a6b55c26d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34661f0f3c6444e69b48e1a6b55c26d2"}]}] Jun 14 19:44:48.239920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-VolumesNegativeTest-246763973 Jun 14 19:44:48.239920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: 34661f0f3c6444e69b48e1a6b55c26d2 Jun 14 19:44:48.239920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-VolumesNegativeTest-246763973 Jun 14 19:44:48.239920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-VolumesNegativeTest-246763973-project Jun 14 19:44:48.239920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:44:48.239920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:44:48.239920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 8450ce25e50440ad81c602df61b4bf62 Jun 14 19:44:48.239920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-VolumesNegativeTest-246763973-project Jun 14 19:44:48.239920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:44:48.239920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c could not be found. Jun 14 19:44:48.239920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '5ece98ca-4dfc-4e24-a4d3-0b99f392d31c'} Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c could not be found. Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:44:48.241274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c could not be found. Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c could not be found. Jun 14 19:44:48.242702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:44:48.243779 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-fe372e81-f3a7-482a-b43d-dcaad454b473 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] Returning 404 to user: Instance 5ece98ca-4dfc-4e24-a4d3-0b99f392d31c could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:44:48.243779 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-fe372e81-f3a7-482a-b43d-dcaad454b473 tempest-VolumesNegativeTest-246763973 tempest-VolumesNegativeTest-246763973-project] 10.222.0.44 "GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c" status: 404 len: 111 microversion: 2.1 time: 0.038689 Jun 14 19:44:48.243779 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 197/420] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:44:48 2022] GET /compute/v2.1/servers/5ece98ca-4dfc-4e24-a4d3-0b99f392d31c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 19:44:48.397829 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-dce6d930-7c41-470f-9bb2-643b040d9528 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:48.408545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-dce6d930-7c41-470f-9bb2-643b040d9528 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:48.410090 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-dce6d930-7c41-470f-9bb2-643b040d9528 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:48.411262 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-dce6d930-7c41-470f-9bb2-643b040d9528 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.205891 Jun 14 19:44:48.411990 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 224/421] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:48 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:49.430521 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1150b9d2-25cd-4dd1-bb38-20082aa3a3f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:49.431749 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-1150b9d2-25cd-4dd1-bb38-20082aa3a3f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:49.439431 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1150b9d2-25cd-4dd1-bb38-20082aa3a3f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:49.439877 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1150b9d2-25cd-4dd1-bb38-20082aa3a3f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:49.440649 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1150b9d2-25cd-4dd1-bb38-20082aa3a3f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:49.441086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1150b9d2-25cd-4dd1-bb38-20082aa3a3f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:49.604766 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-1150b9d2-25cd-4dd1-bb38-20082aa3a3f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:49.613884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-1150b9d2-25cd-4dd1-bb38-20082aa3a3f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:49.615512 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-1150b9d2-25cd-4dd1-bb38-20082aa3a3f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:49.616893 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-1150b9d2-25cd-4dd1-bb38-20082aa3a3f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.190156 Jun 14 19:44:49.618073 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 198/422] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:49 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:44:50.638652 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-18eb2716-4aeb-425a-9932-f14aff2a8951 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:50.639472 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-18eb2716-4aeb-425a-9932-f14aff2a8951 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:50.645805 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-18eb2716-4aeb-425a-9932-f14aff2a8951 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:50.646257 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-18eb2716-4aeb-425a-9932-f14aff2a8951 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:50.647033 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-18eb2716-4aeb-425a-9932-f14aff2a8951 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:50.647469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-18eb2716-4aeb-425a-9932-f14aff2a8951 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:50.789732 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-18eb2716-4aeb-425a-9932-f14aff2a8951 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:50.799192 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-18eb2716-4aeb-425a-9932-f14aff2a8951 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:50.800850 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-18eb2716-4aeb-425a-9932-f14aff2a8951 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:50.802443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-18eb2716-4aeb-425a-9932-f14aff2a8951 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.168045 Jun 14 19:44:50.803108 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 225/423] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:50 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:51.820459 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d869a0f9-4f3d-4b85-b104-ea44fe179bf1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:51.821072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d869a0f9-4f3d-4b85-b104-ea44fe179bf1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:51.827772 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d869a0f9-4f3d-4b85-b104-ea44fe179bf1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:51.828219 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d869a0f9-4f3d-4b85-b104-ea44fe179bf1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:51.828976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d869a0f9-4f3d-4b85-b104-ea44fe179bf1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:51.829430 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d869a0f9-4f3d-4b85-b104-ea44fe179bf1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:51.997790 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d869a0f9-4f3d-4b85-b104-ea44fe179bf1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:52.009047 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d869a0f9-4f3d-4b85-b104-ea44fe179bf1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:52.011024 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d869a0f9-4f3d-4b85-b104-ea44fe179bf1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:52.012286 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d869a0f9-4f3d-4b85-b104-ea44fe179bf1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.195967 Jun 14 19:44:52.012908 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 199/424] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:51 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:53.031229 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-fc9365d3-c7b2-4da7-9ac6-38335be6b7dc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:53.032602 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-fc9365d3-c7b2-4da7-9ac6-38335be6b7dc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:53.039025 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=4 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:53.041747 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fc9365d3-c7b2-4da7-9ac6-38335be6b7dc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:53.042438 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fc9365d3-c7b2-4da7-9ac6-38335be6b7dc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:53.043668 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fc9365d3-c7b2-4da7-9ac6-38335be6b7dc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:53.044319 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fc9365d3-c7b2-4da7-9ac6-38335be6b7dc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:53.196727 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-fc9365d3-c7b2-4da7-9ac6-38335be6b7dc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:53.205516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-fc9365d3-c7b2-4da7-9ac6-38335be6b7dc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:53.207045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-fc9365d3-c7b2-4da7-9ac6-38335be6b7dc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:53.208211 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-fc9365d3-c7b2-4da7-9ac6-38335be6b7dc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.181602 Jun 14 19:44:53.209105 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 226/425] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:53 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:54.228219 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-68259313-8938-413b-add4-eb9685062c03 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:54.228847 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-68259313-8938-413b-add4-eb9685062c03 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:54.235947 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-68259313-8938-413b-add4-eb9685062c03 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:54.236437 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-68259313-8938-413b-add4-eb9685062c03 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:54.237340 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-68259313-8938-413b-add4-eb9685062c03 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:54.237804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-68259313-8938-413b-add4-eb9685062c03 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:54.377177 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-68259313-8938-413b-add4-eb9685062c03 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:54.387088 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-68259313-8938-413b-add4-eb9685062c03 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:54.388577 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-68259313-8938-413b-add4-eb9685062c03 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:54.390014 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-68259313-8938-413b-add4-eb9685062c03 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.166491 Jun 14 19:44:54.390816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 200/426] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:54 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:55.410179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3cd248d5-a258-419e-93ef-2d73a1c73948 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:55.411617 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3cd248d5-a258-419e-93ef-2d73a1c73948 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:55.418827 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3cd248d5-a258-419e-93ef-2d73a1c73948 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:55.419385 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3cd248d5-a258-419e-93ef-2d73a1c73948 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:55.420247 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3cd248d5-a258-419e-93ef-2d73a1c73948 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:55.420738 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3cd248d5-a258-419e-93ef-2d73a1c73948 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:55.558230 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3cd248d5-a258-419e-93ef-2d73a1c73948 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:55.566893 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3cd248d5-a258-419e-93ef-2d73a1c73948 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:55.568379 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3cd248d5-a258-419e-93ef-2d73a1c73948 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:55.569560 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3cd248d5-a258-419e-93ef-2d73a1c73948 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.163608 Jun 14 19:44:55.570108 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 227/427] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:55 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:56.588596 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ccbb21a1-a4bf-48b6-b156-056ca0142d63 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:56.589305 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ccbb21a1-a4bf-48b6-b156-056ca0142d63 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:56.596412 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ccbb21a1-a4bf-48b6-b156-056ca0142d63 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:56.596897 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ccbb21a1-a4bf-48b6-b156-056ca0142d63 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:56.597712 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ccbb21a1-a4bf-48b6-b156-056ca0142d63 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:56.598150 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ccbb21a1-a4bf-48b6-b156-056ca0142d63 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:56.764746 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-ccbb21a1-a4bf-48b6-b156-056ca0142d63 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:56.773470 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-ccbb21a1-a4bf-48b6-b156-056ca0142d63 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:56.775175 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-ccbb21a1-a4bf-48b6-b156-056ca0142d63 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:56.776422 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-ccbb21a1-a4bf-48b6-b156-056ca0142d63 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.191935 Jun 14 19:44:56.776994 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 201/428] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:56 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:57.795242 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a98269b8-91f7-41cd-9ed9-8fc803427c05 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:57.795865 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a98269b8-91f7-41cd-9ed9-8fc803427c05 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:57.802292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a98269b8-91f7-41cd-9ed9-8fc803427c05 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:57.803912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a98269b8-91f7-41cd-9ed9-8fc803427c05 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:57.804758 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a98269b8-91f7-41cd-9ed9-8fc803427c05 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:57.805333 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a98269b8-91f7-41cd-9ed9-8fc803427c05 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:58.034251 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a98269b8-91f7-41cd-9ed9-8fc803427c05 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:58.058037 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a98269b8-91f7-41cd-9ed9-8fc803427c05 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:58.059882 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a98269b8-91f7-41cd-9ed9-8fc803427c05 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:58.060962 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a98269b8-91f7-41cd-9ed9-8fc803427c05 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.270916 Jun 14 19:44:58.061974 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 228/429] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:57 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:44:59.080259 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d868a1ba-8fc3-4fe0-8862-180d050cfb2e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:44:59.080871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d868a1ba-8fc3-4fe0-8862-180d050cfb2e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:44:59.087291 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d868a1ba-8fc3-4fe0-8862-180d050cfb2e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:59.087728 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d868a1ba-8fc3-4fe0-8862-180d050cfb2e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:59.089233 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d868a1ba-8fc3-4fe0-8862-180d050cfb2e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:44:59.089784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d868a1ba-8fc3-4fe0-8862-180d050cfb2e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:44:59.258003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d868a1ba-8fc3-4fe0-8862-180d050cfb2e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:59.267309 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d868a1ba-8fc3-4fe0-8862-180d050cfb2e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:59.268825 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d868a1ba-8fc3-4fe0-8862-180d050cfb2e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:44:59.270025 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d868a1ba-8fc3-4fe0-8862-180d050cfb2e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.194485 Jun 14 19:44:59.270612 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 202/430] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:44:59 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:45:00.288506 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-58318bdb-5e0b-4bad-958c-865785a03ef4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:00.289170 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-58318bdb-5e0b-4bad-958c-865785a03ef4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:00.295364 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-58318bdb-5e0b-4bad-958c-865785a03ef4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:00.295804 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-58318bdb-5e0b-4bad-958c-865785a03ef4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:00.296550 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-58318bdb-5e0b-4bad-958c-865785a03ef4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:00.296975 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-58318bdb-5e0b-4bad-958c-865785a03ef4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:00.422602 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-58318bdb-5e0b-4bad-958c-865785a03ef4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:00.430860 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-58318bdb-5e0b-4bad-958c-865785a03ef4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:00.432922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-58318bdb-5e0b-4bad-958c-865785a03ef4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:00.434085 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-58318bdb-5e0b-4bad-958c-865785a03ef4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.149515 Jun 14 19:45:00.434626 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 229/431] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:45:00 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:45:01.451771 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-e26d61d8-e91b-4e27-88b4-988346425d71 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:01.452334 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-e26d61d8-e91b-4e27-88b4-988346425d71 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:01.458865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e26d61d8-e91b-4e27-88b4-988346425d71 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:01.459317 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e26d61d8-e91b-4e27-88b4-988346425d71 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:01.460070 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e26d61d8-e91b-4e27-88b4-988346425d71 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:01.460502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e26d61d8-e91b-4e27-88b4-988346425d71 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:01.650845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e26d61d8-e91b-4e27-88b4-988346425d71 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:01.660814 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e26d61d8-e91b-4e27-88b4-988346425d71 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:01.662376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e26d61d8-e91b-4e27-88b4-988346425d71 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:01.663552 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-e26d61d8-e91b-4e27-88b4-988346425d71 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.216293 Jun 14 19:45:01.664103 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 203/432] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:45:01 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:45:02.682934 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-241e91a6-6cce-45e5-bb0d-f7cdeb545f5b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:02.683595 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-241e91a6-6cce-45e5-bb0d-f7cdeb545f5b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:02.690824 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-241e91a6-6cce-45e5-bb0d-f7cdeb545f5b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:02.691341 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-241e91a6-6cce-45e5-bb0d-f7cdeb545f5b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:02.692087 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-241e91a6-6cce-45e5-bb0d-f7cdeb545f5b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:02.692600 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-241e91a6-6cce-45e5-bb0d-f7cdeb545f5b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:02.830398 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-241e91a6-6cce-45e5-bb0d-f7cdeb545f5b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:02.838854 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-241e91a6-6cce-45e5-bb0d-f7cdeb545f5b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:02.840381 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-241e91a6-6cce-45e5-bb0d-f7cdeb545f5b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:02.841644 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-241e91a6-6cce-45e5-bb0d-f7cdeb545f5b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.163716 Jun 14 19:45:02.842257 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 230/433] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:45:02 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:45:03.055236 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-977976680", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1117510646", "security_groups": [{"name": "tempest-secgroup-smoke-1077359228"}], "networks": [{"uuid": "e936d617-1227-4cfe-99e2-b4766f4b0bc8"}], "block_device_mapping_v2": [{"uuid": "77fc32a0-d1a6-4787-8805-87a14ff9dae9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:03.169548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.network.neutron [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] validate_networks() for [('e936d617-1227-4cfe-99e2-b4766f4b0bc8', None, None, None, None, None)] {{(pid=124069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:45:03.550211 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Flavor limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:45:03.550632 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Image limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:45:03.551100 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Flavor pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:45:03.551538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Image pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:45:03.551946 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:45:03.561518 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:03.561969 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:03.562769 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:03.563201 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:03.579442 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Getting quotas for project 780be61f7cb0429fbd97488f41a6b644. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:45:03.583360 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Getting quotas for user 7a5fb1cff46d4e3e8e23f9a788cec9ed and project 780be61f7cb0429fbd97488f41a6b644. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:45:03.639281 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Going to run 1 instances... {{(pid=124069) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:45:03.641399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77fc32a0-d1a6-4787-8805-87a14ff9dae9',volume_size=None,volume_type=None)] {{(pid=124069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:45:03.767424 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-cb7e8a55-31cd-4855-ae0e-2b4c379504cc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.715963 Jun 14 19:45:03.768270 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 204/434] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:45:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:45:03.778766 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-7ed7e5de-f57f-42cc-8fb8-5d10532b54e1 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:03.779484 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-7ed7e5de-f57f-42cc-8fb8-5d10532b54e1 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:03.834615 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-7ed7e5de-f57f-42cc-8fb8-5d10532b54e1 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:03.842487 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-7ed7e5de-f57f-42cc-8fb8-5d10532b54e1 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1088 microversion: 2.1 time: 0.068398 Jun 14 19:45:03.843053 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 231/435] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:03 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:03.860821 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-7d3bf7bf-4eaf-4c2a-9f23-aa35e21f7055 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:03.861448 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-7d3bf7bf-4eaf-4c2a-9f23-aa35e21f7055 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:03.868319 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7d3bf7bf-4eaf-4c2a-9f23-aa35e21f7055 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:03.868779 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7d3bf7bf-4eaf-4c2a-9f23-aa35e21f7055 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:03.869577 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7d3bf7bf-4eaf-4c2a-9f23-aa35e21f7055 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:03.870010 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7d3bf7bf-4eaf-4c2a-9f23-aa35e21f7055 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:04.012042 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-7d3bf7bf-4eaf-4c2a-9f23-aa35e21f7055 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:04.021338 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-7d3bf7bf-4eaf-4c2a-9f23-aa35e21f7055 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:04.022963 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-7d3bf7bf-4eaf-4c2a-9f23-aa35e21f7055 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:04.024210 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-7d3bf7bf-4eaf-4c2a-9f23-aa35e21f7055 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.167691 Jun 14 19:45:04.024865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 205/436] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:45:03 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:45:04.859291 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-61466613-5be4-4cda-a500-a3d627490122 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:04.859904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-61466613-5be4-4cda-a500-a3d627490122 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:04.866003 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-61466613-5be4-4cda-a500-a3d627490122 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:04.866655 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-61466613-5be4-4cda-a500-a3d627490122 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:04.867420 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-61466613-5be4-4cda-a500-a3d627490122 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:04.867964 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-61466613-5be4-4cda-a500-a3d627490122 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:04.938359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-61466613-5be4-4cda-a500-a3d627490122 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:04.945850 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-61466613-5be4-4cda-a500-a3d627490122 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1204 microversion: 2.1 time: 0.090349 Jun 14 19:45:04.946512 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 232/437] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:04 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1204 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:05.046346 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-84f80190-90d7-4fb6-bb07-a2b4c58e02fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:05.046919 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-84f80190-90d7-4fb6-bb07-a2b4c58e02fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:05.053519 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-84f80190-90d7-4fb6-bb07-a2b4c58e02fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:05.054002 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-84f80190-90d7-4fb6-bb07-a2b4c58e02fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:05.054819 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-84f80190-90d7-4fb6-bb07-a2b4c58e02fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:05.055257 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-84f80190-90d7-4fb6-bb07-a2b4c58e02fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:05.324609 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-84f80190-90d7-4fb6-bb07-a2b4c58e02fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:05.336526 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-84f80190-90d7-4fb6-bb07-a2b4c58e02fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:05.340551 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-84f80190-90d7-4fb6-bb07-a2b4c58e02fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:05.342197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-84f80190-90d7-4fb6-bb07-a2b4c58e02fd tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.300532 Jun 14 19:45:05.343088 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 206/438] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:45:05 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:45:05.964650 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4e8fd017-41fd-49d8-b87d-0d483d776191 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:05.965185 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4e8fd017-41fd-49d8-b87d-0d483d776191 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:05.971106 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4e8fd017-41fd-49d8-b87d-0d483d776191 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:05.971568 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4e8fd017-41fd-49d8-b87d-0d483d776191 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:05.972329 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4e8fd017-41fd-49d8-b87d-0d483d776191 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:05.972762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4e8fd017-41fd-49d8-b87d-0d483d776191 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:06.104247 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4e8fd017-41fd-49d8-b87d-0d483d776191 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:06.112243 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4e8fd017-41fd-49d8-b87d-0d483d776191 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1260 microversion: 2.1 time: 0.152026 Jun 14 19:45:06.112919 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 233/439] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:05 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:06.362216 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-276c3aab-f670-400b-a219-f91f53c85d8e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:06.362797 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-276c3aab-f670-400b-a219-f91f53c85d8e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:06.377547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-91014c4d-0856-44aa-9ff3-5b7ede9b493d req-b78a4b26-a1d1-4109-aa33-fb21e16713fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a0421fa-7df8-4d48-b112-fff79061f5ae", "tag": "04d8f989-9542-404e-a49a-add222e0ca49"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:06.387450 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-276c3aab-f670-400b-a219-f91f53c85d8e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:06.387909 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-276c3aab-f670-400b-a219-f91f53c85d8e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:06.388692 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-276c3aab-f670-400b-a219-f91f53c85d8e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:06.392946 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-91014c4d-0856-44aa-9ff3-5b7ede9b493d req-b78a4b26-a1d1-4109-aa33-fb21e16713fd service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:06.393402 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-91014c4d-0856-44aa-9ff3-5b7ede9b493d req-b78a4b26-a1d1-4109-aa33-fb21e16713fd service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:06.394771 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-276c3aab-f670-400b-a219-f91f53c85d8e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:06.421056 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-91014c4d-0856-44aa-9ff3-5b7ede9b493d req-b78a4b26-a1d1-4109-aa33-fb21e16713fd service nova] Creating event network-changed:04d8f989-9542-404e-a49a-add222e0ca49 for instance 2a0421fa-7df8-4d48-b112-fff79061f5ae on hv-cinder-84580 Jun 14 19:45:06.429133 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-91014c4d-0856-44aa-9ff3-5b7ede9b493d req-b78a4b26-a1d1-4109-aa33-fb21e16713fd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056062 Jun 14 19:45:06.429787 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 234/440] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:45:06.586540 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-276c3aab-f670-400b-a219-f91f53c85d8e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:06.595027 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-276c3aab-f670-400b-a219-f91f53c85d8e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:06.596521 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-276c3aab-f670-400b-a219-f91f53c85d8e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:06.597704 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-276c3aab-f670-400b-a219-f91f53c85d8e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.240474 Jun 14 19:45:06.598263 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 207/441] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:45:06 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:45:07.130149 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c50fb8dc-5e51-417c-9ac2-663fb4866abf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:07.130837 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c50fb8dc-5e51-417c-9ac2-663fb4866abf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:07.137119 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c50fb8dc-5e51-417c-9ac2-663fb4866abf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:07.137618 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c50fb8dc-5e51-417c-9ac2-663fb4866abf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:07.138445 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c50fb8dc-5e51-417c-9ac2-663fb4866abf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:07.138889 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c50fb8dc-5e51-417c-9ac2-663fb4866abf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:07.268072 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c50fb8dc-5e51-417c-9ac2-663fb4866abf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:07.275394 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c50fb8dc-5e51-417c-9ac2-663fb4866abf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1260 microversion: 2.1 time: 0.149421 Jun 14 19:45:07.275979 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 235/442] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:07 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:07.615965 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-034566d8-692a-4dcd-8141-1152b86c14e3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:07.616571 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-034566d8-692a-4dcd-8141-1152b86c14e3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:07.623254 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-034566d8-692a-4dcd-8141-1152b86c14e3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:07.623702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-034566d8-692a-4dcd-8141-1152b86c14e3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:07.624456 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-034566d8-692a-4dcd-8141-1152b86c14e3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:07.624916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-034566d8-692a-4dcd-8141-1152b86c14e3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:07.832974 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-034566d8-692a-4dcd-8141-1152b86c14e3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:07.843363 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-034566d8-692a-4dcd-8141-1152b86c14e3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:07.844819 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-034566d8-692a-4dcd-8141-1152b86c14e3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:07.845995 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-034566d8-692a-4dcd-8141-1152b86c14e3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.233948 Jun 14 19:45:07.846546 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 208/443] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:45:07 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:45:08.294256 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c4922524-c6ab-414f-92d5-bd787910c8e9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:08.294867 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c4922524-c6ab-414f-92d5-bd787910c8e9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:08.300959 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c4922524-c6ab-414f-92d5-bd787910c8e9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:08.302305 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c4922524-c6ab-414f-92d5-bd787910c8e9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:08.303285 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c4922524-c6ab-414f-92d5-bd787910c8e9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:08.303872 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c4922524-c6ab-414f-92d5-bd787910c8e9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:08.442436 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c4922524-c6ab-414f-92d5-bd787910c8e9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:08.450881 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c4922524-c6ab-414f-92d5-bd787910c8e9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1260 microversion: 2.1 time: 0.162097 Jun 14 19:45:08.451440 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 236/444] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:08 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:08.863946 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-793051dd-d185-4a42-8395-c49c66cb1992 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:08.864545 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-793051dd-d185-4a42-8395-c49c66cb1992 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:08.871480 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-793051dd-d185-4a42-8395-c49c66cb1992 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:08.871916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-793051dd-d185-4a42-8395-c49c66cb1992 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:08.872662 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-793051dd-d185-4a42-8395-c49c66cb1992 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:08.873093 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-793051dd-d185-4a42-8395-c49c66cb1992 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:09.003500 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-793051dd-d185-4a42-8395-c49c66cb1992 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:09.011992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-793051dd-d185-4a42-8395-c49c66cb1992 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:09.013534 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-793051dd-d185-4a42-8395-c49c66cb1992 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:09.014687 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-793051dd-d185-4a42-8395-c49c66cb1992 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.154584 Jun 14 19:45:09.015241 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 209/445] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:45:08 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:45:09.468057 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-59409b6a-77b0-4263-b084-f988233efb42 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:09.468659 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-59409b6a-77b0-4263-b084-f988233efb42 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:09.474685 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-59409b6a-77b0-4263-b084-f988233efb42 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:09.475131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-59409b6a-77b0-4263-b084-f988233efb42 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:09.475887 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-59409b6a-77b0-4263-b084-f988233efb42 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:09.476321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-59409b6a-77b0-4263-b084-f988233efb42 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:09.603100 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-59409b6a-77b0-4263-b084-f988233efb42 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:09.611338 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-59409b6a-77b0-4263-b084-f988233efb42 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1260 microversion: 2.1 time: 0.147601 Jun 14 19:45:09.611900 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 237/446] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:09 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:10.032894 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d50bf9e3-8bc9-462b-901d-d95a3029d1df tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:10.033602 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d50bf9e3-8bc9-462b-901d-d95a3029d1df tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:10.040207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d50bf9e3-8bc9-462b-901d-d95a3029d1df tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:10.040687 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d50bf9e3-8bc9-462b-901d-d95a3029d1df tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:10.041482 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d50bf9e3-8bc9-462b-901d-d95a3029d1df tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:10.041924 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d50bf9e3-8bc9-462b-901d-d95a3029d1df tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:10.171971 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d50bf9e3-8bc9-462b-901d-d95a3029d1df tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:10.174303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:10.181982 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d50bf9e3-8bc9-462b-901d-d95a3029d1df tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:10.184015 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d50bf9e3-8bc9-462b-901d-d95a3029d1df tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:10.185169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d50bf9e3-8bc9-462b-901d-d95a3029d1df tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.156104 Jun 14 19:45:10.185756 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 210/447] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:45:10 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:45:10.628211 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-55c50821-3067-40fc-bd0a-e2f5b077967b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:10.628823 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-55c50821-3067-40fc-bd0a-e2f5b077967b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:10.634787 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-55c50821-3067-40fc-bd0a-e2f5b077967b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:10.635229 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-55c50821-3067-40fc-bd0a-e2f5b077967b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:10.635978 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-55c50821-3067-40fc-bd0a-e2f5b077967b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:10.636452 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-55c50821-3067-40fc-bd0a-e2f5b077967b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:10.774355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-55c50821-3067-40fc-bd0a-e2f5b077967b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:10.782382 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-55c50821-3067-40fc-bd0a-e2f5b077967b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1260 microversion: 2.1 time: 0.158362 Jun 14 19:45:10.782948 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 238/448] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:10 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:45:11.203331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d0c0625e-4f67-4624-a90d-d34f74ccb6e6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:11.203935 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d0c0625e-4f67-4624-a90d-d34f74ccb6e6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:11.211340 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d0c0625e-4f67-4624-a90d-d34f74ccb6e6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:11.211782 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d0c0625e-4f67-4624-a90d-d34f74ccb6e6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:11.212534 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d0c0625e-4f67-4624-a90d-d34f74ccb6e6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:11.212964 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d0c0625e-4f67-4624-a90d-d34f74ccb6e6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:11.338417 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d0c0625e-4f67-4624-a90d-d34f74ccb6e6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:11.347586 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d0c0625e-4f67-4624-a90d-d34f74ccb6e6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:11.349086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d0c0625e-4f67-4624-a90d-d34f74ccb6e6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:11.350254 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d0c0625e-4f67-4624-a90d-d34f74ccb6e6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.151540 Jun 14 19:45:11.350804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 211/449] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:45:11 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:45:11.799569 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-824b3236-fa96-4d66-8296-421d3fe26440 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:11.800173 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-824b3236-fa96-4d66-8296-421d3fe26440 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:11.806201 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-824b3236-fa96-4d66-8296-421d3fe26440 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:11.806656 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-824b3236-fa96-4d66-8296-421d3fe26440 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:11.807409 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-824b3236-fa96-4d66-8296-421d3fe26440 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:11.807873 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-824b3236-fa96-4d66-8296-421d3fe26440 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:11.939027 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-824b3236-fa96-4d66-8296-421d3fe26440 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:11.946465 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-824b3236-fa96-4d66-8296-421d3fe26440 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1260 microversion: 2.1 time: 0.150830 Jun 14 19:45:11.947020 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 239/450] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:11 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:12.207819 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-d179adc7-899f-440b-93d4-dc930ce91311 req-eb06c5ba-a1bc-4855-9305-5dc9a586e337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2d9ed3-941a-496c-b3c8-a9a5648cd846", "name": "network-vif-plugged", "status": "completed", "tag": "5445a8aa-6257-4a17-8a1b-eff254fa9a9d"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:12.218291 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-d179adc7-899f-440b-93d4-dc930ce91311 req-eb06c5ba-a1bc-4855-9305-5dc9a586e337 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:12.218743 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-d179adc7-899f-440b-93d4-dc930ce91311 req-eb06c5ba-a1bc-4855-9305-5dc9a586e337 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:12.229717 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-d179adc7-899f-440b-93d4-dc930ce91311 req-eb06c5ba-a1bc-4855-9305-5dc9a586e337 service nova] Creating event network-vif-plugged:5445a8aa-6257-4a17-8a1b-eff254fa9a9d for instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 on hv-cinder-84580 Jun 14 19:45:12.235172 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-d179adc7-899f-440b-93d4-dc930ce91311 req-eb06c5ba-a1bc-4855-9305-5dc9a586e337 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031039 Jun 14 19:45:12.235818 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 212/451] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:45:12.368220 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4ec80b7b-d3cb-441b-8bad-d6e841ca8d70 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:12.368785 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4ec80b7b-d3cb-441b-8bad-d6e841ca8d70 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:12.374838 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4ec80b7b-d3cb-441b-8bad-d6e841ca8d70 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:12.375286 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4ec80b7b-d3cb-441b-8bad-d6e841ca8d70 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:12.376062 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4ec80b7b-d3cb-441b-8bad-d6e841ca8d70 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:12.376480 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4ec80b7b-d3cb-441b-8bad-d6e841ca8d70 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:12.504554 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4ec80b7b-d3cb-441b-8bad-d6e841ca8d70 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:12.513701 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4ec80b7b-d3cb-441b-8bad-d6e841ca8d70 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:12.515207 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4ec80b7b-d3cb-441b-8bad-d6e841ca8d70 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:12.516351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4ec80b7b-d3cb-441b-8bad-d6e841ca8d70 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.152107 Jun 14 19:45:12.516916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 240/452] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:45:12 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:45:12.964395 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ae55a6b4-702f-4092-9661-4a24a08588f9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:12.965013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ae55a6b4-702f-4092-9661-4a24a08588f9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:12.971359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ae55a6b4-702f-4092-9661-4a24a08588f9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:12.971801 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ae55a6b4-702f-4092-9661-4a24a08588f9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:12.972549 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ae55a6b4-702f-4092-9661-4a24a08588f9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:12.972979 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ae55a6b4-702f-4092-9661-4a24a08588f9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:13.103297 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-ae55a6b4-702f-4092-9661-4a24a08588f9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:13.111673 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-ae55a6b4-702f-4092-9661-4a24a08588f9 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1260 microversion: 2.1 time: 0.151654 Jun 14 19:45:13.112239 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 213/453] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:12 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:13.534404 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-6faf79f4-eecc-4d79-a60a-09731b2b60f9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:13.535014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-6faf79f4-eecc-4d79-a60a-09731b2b60f9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:13.537021 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:13.543087 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6faf79f4-eecc-4d79-a60a-09731b2b60f9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:13.543538 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6faf79f4-eecc-4d79-a60a-09731b2b60f9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:13.544295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6faf79f4-eecc-4d79-a60a-09731b2b60f9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:13.544727 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6faf79f4-eecc-4d79-a60a-09731b2b60f9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:13.547777 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=100 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:13.675046 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-6faf79f4-eecc-4d79-a60a-09731b2b60f9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:13.683364 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-6faf79f4-eecc-4d79-a60a-09731b2b60f9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:13.684859 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-6faf79f4-eecc-4d79-a60a-09731b2b60f9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:13.686054 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-6faf79f4-eecc-4d79-a60a-09731b2b60f9 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.155521 Jun 14 19:45:13.686607 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 241/454] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:45:13 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:45:14.128683 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-3f3a7e40-6ec1-491b-9786-2905641b1123 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:14.129295 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-3f3a7e40-6ec1-491b-9786-2905641b1123 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:14.131694 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:14.132370 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=6 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:14.138603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3f3a7e40-6ec1-491b-9786-2905641b1123 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:14.139049 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3f3a7e40-6ec1-491b-9786-2905641b1123 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:14.139808 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3f3a7e40-6ec1-491b-9786-2905641b1123 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:14.140237 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3f3a7e40-6ec1-491b-9786-2905641b1123 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:14.271420 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-3f3a7e40-6ec1-491b-9786-2905641b1123 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:14.279721 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-3f3a7e40-6ec1-491b-9786-2905641b1123 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1260 microversion: 2.1 time: 0.154925 Jun 14 19:45:14.280271 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 214/455] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:14 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:14.703726 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-70391921-8c4e-4a3c-807e-382756c291ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:14.704335 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-70391921-8c4e-4a3c-807e-382756c291ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:14.706185 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:14.711752 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-70391921-8c4e-4a3c-807e-382756c291ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:14.712201 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-70391921-8c4e-4a3c-807e-382756c291ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:14.712949 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-70391921-8c4e-4a3c-807e-382756c291ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:14.713400 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-70391921-8c4e-4a3c-807e-382756c291ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:14.841674 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-70391921-8c4e-4a3c-807e-382756c291ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:14.850122 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-70391921-8c4e-4a3c-807e-382756c291ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:14.851630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-70391921-8c4e-4a3c-807e-382756c291ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:14.852775 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-70391921-8c4e-4a3c-807e-382756c291ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1807 microversion: 2.20 time: 0.153021 Jun 14 19:45:14.853334 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 242/456] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:45:14 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:45:15.299255 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4d6984be-3275-4da6-b192-e4fe8e055a5a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:15.299871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4d6984be-3275-4da6-b192-e4fe8e055a5a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:15.306471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4d6984be-3275-4da6-b192-e4fe8e055a5a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:15.306999 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4d6984be-3275-4da6-b192-e4fe8e055a5a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:15.307944 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4d6984be-3275-4da6-b192-e4fe8e055a5a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:15.308673 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4d6984be-3275-4da6-b192-e4fe8e055a5a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:15.449808 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4d6984be-3275-4da6-b192-e4fe8e055a5a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:15.459381 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4d6984be-3275-4da6-b192-e4fe8e055a5a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1260 microversion: 2.1 time: 0.167116 Jun 14 19:45:15.460335 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 215/457] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:15 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:45:15.871469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-566138d1-fec0-4196-8fa7-5a646e5bd52d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:15.872076 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-566138d1-fec0-4196-8fa7-5a646e5bd52d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:15.878238 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-566138d1-fec0-4196-8fa7-5a646e5bd52d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:15.878690 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-566138d1-fec0-4196-8fa7-5a646e5bd52d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:15.879455 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-566138d1-fec0-4196-8fa7-5a646e5bd52d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:15.879892 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-566138d1-fec0-4196-8fa7-5a646e5bd52d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:16.008480 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-566138d1-fec0-4196-8fa7-5a646e5bd52d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:16.017443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-566138d1-fec0-4196-8fa7-5a646e5bd52d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:16.018947 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-566138d1-fec0-4196-8fa7-5a646e5bd52d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:16.020087 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-566138d1-fec0-4196-8fa7-5a646e5bd52d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1794 microversion: 2.20 time: 0.152542 Jun 14 19:45:16.020644 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 243/458] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:45:15 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:45:16.477024 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-10138ade-1318-4ef1-b111-a86ebc58edeb tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:16.477664 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-10138ade-1318-4ef1-b111-a86ebc58edeb tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:16.484323 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-10138ade-1318-4ef1-b111-a86ebc58edeb tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:16.484769 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-10138ade-1318-4ef1-b111-a86ebc58edeb tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:16.485561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-10138ade-1318-4ef1-b111-a86ebc58edeb tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:16.485996 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-10138ade-1318-4ef1-b111-a86ebc58edeb tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:16.615767 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-10138ade-1318-4ef1-b111-a86ebc58edeb tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:16.623734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-10138ade-1318-4ef1-b111-a86ebc58edeb tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1260 microversion: 2.1 time: 0.150017 Jun 14 19:45:16.624297 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 216/459] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:16 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:17.640551 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4dc3eb53-8592-4eb2-8295-12023a12746b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:17.641156 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4dc3eb53-8592-4eb2-8295-12023a12746b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:17.647566 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4dc3eb53-8592-4eb2-8295-12023a12746b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:17.648008 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4dc3eb53-8592-4eb2-8295-12023a12746b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:17.648754 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4dc3eb53-8592-4eb2-8295-12023a12746b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:17.649181 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4dc3eb53-8592-4eb2-8295-12023a12746b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:17.782594 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4dc3eb53-8592-4eb2-8295-12023a12746b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:17.789968 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4dc3eb53-8592-4eb2-8295-12023a12746b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1260 microversion: 2.1 time: 0.153836 Jun 14 19:45:17.790527 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 244/460] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:17 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:18.247095 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-2b22e0f3-6360-4b94-9741-d7c14300e2ee req-f746a029-e74f-4f1f-a23a-6fcdedea1bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0421fa-7df8-4d48-b112-fff79061f5ae", "name": "network-vif-plugged", "status": "completed", "tag": "04d8f989-9542-404e-a49a-add222e0ca49"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:18.251667 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:18.258393 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-2b22e0f3-6360-4b94-9741-d7c14300e2ee req-f746a029-e74f-4f1f-a23a-6fcdedea1bcb service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:18.258842 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-2b22e0f3-6360-4b94-9741-d7c14300e2ee req-f746a029-e74f-4f1f-a23a-6fcdedea1bcb service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:18.270920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-2b22e0f3-6360-4b94-9741-d7c14300e2ee req-f746a029-e74f-4f1f-a23a-6fcdedea1bcb service nova] Creating event network-vif-plugged:04d8f989-9542-404e-a49a-add222e0ca49 for instance 2a0421fa-7df8-4d48-b112-fff79061f5ae on hv-cinder-84580 Jun 14 19:45:18.275617 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-2b22e0f3-6360-4b94-9741-d7c14300e2ee req-f746a029-e74f-4f1f-a23a-6fcdedea1bcb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032181 Jun 14 19:45:18.276207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 217/461] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:45:18.603697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-21d990c1-d1b4-4793-be97-12d37e4a84fa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:18.604301 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-21d990c1-d1b4-4793-be97-12d37e4a84fa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:18.610887 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-21d990c1-d1b4-4793-be97-12d37e4a84fa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:18.611333 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-21d990c1-d1b4-4793-be97-12d37e4a84fa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:18.612098 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-21d990c1-d1b4-4793-be97-12d37e4a84fa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:18.612529 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-21d990c1-d1b4-4793-be97-12d37e4a84fa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:18.736411 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.objects.instance [None req-21d990c1-d1b4-4793-be97-12d37e4a84fa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lazy-loading 'services' on Instance uuid 519d4f97-34a0-4df8-85fe-98149ad589a8 {{(pid=124068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:45:18.807405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b30af5d8-112a-46b7-b89d-3dcb067df78d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:18.808102 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b30af5d8-112a-46b7-b89d-3dcb067df78d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:18.814524 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b30af5d8-112a-46b7-b89d-3dcb067df78d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:18.814898 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b30af5d8-112a-46b7-b89d-3dcb067df78d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:18.815662 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b30af5d8-112a-46b7-b89d-3dcb067df78d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:18.816094 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b30af5d8-112a-46b7-b89d-3dcb067df78d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:18.852220 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-21d990c1-d1b4-4793-be97-12d37e4a84fa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/os-volume_attachments/71d631b7-5e83-4360-9b95-e7b2e15ce0c0" status: 202 len: 0 microversion: 2.1 time: 0.252827 Jun 14 19:45:18.852854 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 245/462] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 14 19:45:18 2022] DELETE /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/os-volume_attachments/71d631b7-5e83-4360-9b95-e7b2e15ce0c0 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:45:18.970627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-b30af5d8-112a-46b7-b89d-3dcb067df78d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:18.978015 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b30af5d8-112a-46b7-b89d-3dcb067df78d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1260 microversion: 2.1 time: 0.174768 Jun 14 19:45:18.978678 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 218/463] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:18 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:19.508941 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a120d8de-b874-4a54-8b78-f0833b071347 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:19.509569 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a120d8de-b874-4a54-8b78-f0833b071347 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:19.516670 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a120d8de-b874-4a54-8b78-f0833b071347 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:19.517118 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a120d8de-b874-4a54-8b78-f0833b071347 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:19.517919 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a120d8de-b874-4a54-8b78-f0833b071347 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:19.518356 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a120d8de-b874-4a54-8b78-f0833b071347 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:19.542175 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a120d8de-b874-4a54-8b78-f0833b071347 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7/ips" status: 200 len: 148 microversion: 2.1 time: 0.037445 Jun 14 19:45:19.542754 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 246/464] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 14 19:45:19 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:45:19.553117 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d1e54582-3388-46ba-8f48-565b955ba240 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09e61fce-e4b1-4ce3-9bd5-7528fa8b7f5b"}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:19.554204 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d1e54582-3388-46ba-8f48-565b955ba240 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:19.561207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d1e54582-3388-46ba-8f48-565b955ba240 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:19.561862 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d1e54582-3388-46ba-8f48-565b955ba240 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:19.562618 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d1e54582-3388-46ba-8f48-565b955ba240 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:19.563051 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d1e54582-3388-46ba-8f48-565b955ba240 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:19.641549 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-d1e54582-3388-46ba-8f48-565b955ba240 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] HTTP exception thrown: Invalid volume: volume 09e61fce-e4b1-4ce3-9bd5-7528fa8b7f5b is already attached to instances: f1434a82-cdbc-474b-95c4-44331ae4a084 Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d1e54582-3388-46ba-8f48-565b955ba240 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Request method failure captured: Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: POST /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7/os-volume_attachments HTTP/1.1 Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 74 Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSSLZpR2w_xFmfjar75tGJDU2sD62hg-I9tSk--QtfqjFSlliGkRH_W6CYwZ7Iph2aF4fxrjxzyeJzd_hl0QyZ4Pw-2UckaxY5_2H0QoR9Blg4BQM7Y5TpsnBrEMi60m5uD-Uzx7H-VX8XJXxLhIjXrvmJpguoa2gF4eYzoPZCLZyc Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:45:19.643265 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:45:19.644765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}] Jun 14 19:45:19.644765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:45:19.644765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:45:19.644765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:45:19.644765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:45:19.644765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:45:19.644765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:45:19.644765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 323c51f037db4ecca2f66cb6e9879246 Jun 14 19:45:19.644765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:45:19.644765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Jun 14 19:45:19.644765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {"volumeAttachment": {"volumeId": "09e61fce-e4b1-4ce3-9bd5-7528fa8b7f5b"}} Jun 14 19:45:19.644765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Invalid volume: volume 09e61fce-e4b1-4ce3-9bd5-7528fa8b7f5b is already attached to instances: f1434a82-cdbc-474b-95c4-44331ae4a084 Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'server_id': '4e2353fc-c6c0-4c56-8423-5bc7b343acc7', 'body': {'volumeAttachment': {'volumeId': '09e61fce-e4b1-4ce3-9bd5-7528fa8b7f5b'}}} Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 09e61fce-e4b1-4ce3-9bd5-7528fa8b7f5b is already attached to instances: f1434a82-cdbc-474b-95c4-44331ae4a084 Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:45:19.645816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 09e61fce-e4b1-4ce3-9bd5-7528fa8b7f5b is already attached to instances: f1434a82-cdbc-474b-95c4-44331ae4a084 Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:45:19.647179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:45:19.648906 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:45:19.648906 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:45:19.648906 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:45:19.648906 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 09e61fce-e4b1-4ce3-9bd5-7528fa8b7f5b is already attached to instances: f1434a82-cdbc-474b-95c4-44331ae4a084 Jun 14 19:45:19.648906 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:45:19.648906 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d1e54582-3388-46ba-8f48-565b955ba240 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Returning 400 to user: Invalid volume: volume 09e61fce-e4b1-4ce3-9bd5-7528fa8b7f5b is already attached to instances: f1434a82-cdbc-474b-95c4-44331ae4a084 {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:45:19.648906 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d1e54582-3388-46ba-8f48-565b955ba240 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "POST /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095637 Jun 14 19:45:19.648906 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 219/465] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 14 19:45:19 2022] POST /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 14 19:45:19.654500 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-26bd8eaf-75ae-4813-a2f5-44fe517e898d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:19.655169 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-26bd8eaf-75ae-4813-a2f5-44fe517e898d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:19.661731 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-26bd8eaf-75ae-4813-a2f5-44fe517e898d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:19.662184 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-26bd8eaf-75ae-4813-a2f5-44fe517e898d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:19.662946 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-26bd8eaf-75ae-4813-a2f5-44fe517e898d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:19.663380 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-26bd8eaf-75ae-4813-a2f5-44fe517e898d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:19.687781 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-26bd8eaf-75ae-4813-a2f5-44fe517e898d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Going to try to terminate instance {{(pid=124068) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:45:19.764513 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-26bd8eaf-75ae-4813-a2f5-44fe517e898d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 204 len: 0 microversion: 2.1 time: 0.113575 Jun 14 19:45:19.765163 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 247/466] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:45:19 2022] DELETE /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:45:19.773330 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1ca091bc-a955-449e-8bb6-36eb92d08a5f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:19.773967 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-1ca091bc-a955-449e-8bb6-36eb92d08a5f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:19.780956 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1ca091bc-a955-449e-8bb6-36eb92d08a5f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:19.781450 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1ca091bc-a955-449e-8bb6-36eb92d08a5f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:19.782213 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1ca091bc-a955-449e-8bb6-36eb92d08a5f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:19.782644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1ca091bc-a955-449e-8bb6-36eb92d08a5f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:19.914641 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-1ca091bc-a955-449e-8bb6-36eb92d08a5f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:19.923406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-1ca091bc-a955-449e-8bb6-36eb92d08a5f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1681 microversion: 2.1 time: 0.153876 Jun 14 19:45:19.923974 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 220/467] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:19 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:19.995473 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-5f2d78ef-bbeb-4ca1-914a-6e8cf6da1588 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:19.996163 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-5f2d78ef-bbeb-4ca1-914a-6e8cf6da1588 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:20.002678 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5f2d78ef-bbeb-4ca1-914a-6e8cf6da1588 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:20.003155 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5f2d78ef-bbeb-4ca1-914a-6e8cf6da1588 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:20.003930 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5f2d78ef-bbeb-4ca1-914a-6e8cf6da1588 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:20.004337 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5f2d78ef-bbeb-4ca1-914a-6e8cf6da1588 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:20.136068 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-5f2d78ef-bbeb-4ca1-914a-6e8cf6da1588 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:20.144022 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-5f2d78ef-bbeb-4ca1-914a-6e8cf6da1588 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1260 microversion: 2.1 time: 0.152720 Jun 14 19:45:20.144606 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 248/468] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:19 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:20.941674 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-aff2e313-72f8-4a97-b38c-eb6cfc7bb50f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:20.942213 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-aff2e313-72f8-4a97-b38c-eb6cfc7bb50f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:20.948624 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-aff2e313-72f8-4a97-b38c-eb6cfc7bb50f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:20.949071 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-aff2e313-72f8-4a97-b38c-eb6cfc7bb50f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:20.949850 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-aff2e313-72f8-4a97-b38c-eb6cfc7bb50f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:20.950283 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-aff2e313-72f8-4a97-b38c-eb6cfc7bb50f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:21.085748 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-aff2e313-72f8-4a97-b38c-eb6cfc7bb50f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:21.094627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-aff2e313-72f8-4a97-b38c-eb6cfc7bb50f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1681 microversion: 2.1 time: 0.156849 Jun 14 19:45:21.095220 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 221/469] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:20 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:21.160939 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3c4517be-c8f8-4171-a483-f6a065f2408a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:21.161729 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3c4517be-c8f8-4171-a483-f6a065f2408a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:21.167776 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3c4517be-c8f8-4171-a483-f6a065f2408a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:21.168307 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3c4517be-c8f8-4171-a483-f6a065f2408a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:21.169078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3c4517be-c8f8-4171-a483-f6a065f2408a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:21.170165 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3c4517be-c8f8-4171-a483-f6a065f2408a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:21.299803 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3c4517be-c8f8-4171-a483-f6a065f2408a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:21.307098 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3c4517be-c8f8-4171-a483-f6a065f2408a tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1445 microversion: 2.1 time: 0.150350 Jun 14 19:45:21.307653 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 249/470] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:21 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1445 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:45:21.323798 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-54e54388-c6f6-42a2-a999-7b058320474d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:21.324399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-54e54388-c6f6-42a2-a999-7b058320474d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:21.331145 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-54e54388-c6f6-42a2-a999-7b058320474d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:21.331593 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-54e54388-c6f6-42a2-a999-7b058320474d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:21.332338 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-54e54388-c6f6-42a2-a999-7b058320474d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:21.332766 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-54e54388-c6f6-42a2-a999-7b058320474d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:21.465707 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-54e54388-c6f6-42a2-a999-7b058320474d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:21.473213 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-54e54388-c6f6-42a2-a999-7b058320474d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1445 microversion: 2.1 time: 0.153137 Jun 14 19:45:21.473793 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 222/471] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:21 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:22.074905 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-40acc77d-6344-4c8f-8bd7-bddae9cf6fda tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:22.081175 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-40acc77d-6344-4c8f-8bd7-bddae9cf6fda tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:22.081653 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-40acc77d-6344-4c8f-8bd7-bddae9cf6fda tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:22.104900 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-40acc77d-6344-4c8f-8bd7-bddae9cf6fda tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Going to try to stop instance {{(pid=124068) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 14 19:45:22.113595 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-fe157d0e-729b-4aad-b613-c1a4cf551349 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:22.115277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-fe157d0e-729b-4aad-b613-c1a4cf551349 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:22.123458 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fe157d0e-729b-4aad-b613-c1a4cf551349 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:22.125459 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fe157d0e-729b-4aad-b613-c1a4cf551349 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:22.126443 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fe157d0e-729b-4aad-b613-c1a4cf551349 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:22.127035 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fe157d0e-729b-4aad-b613-c1a4cf551349 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:22.159980 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-40acc77d-6344-4c8f-8bd7-bddae9cf6fda tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "POST /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/action" status: 202 len: 0 microversion: 2.1 time: 0.085196 Jun 14 19:45:22.159980 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 250/472] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 14 19:45:22 2022] POST /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:45:22.170248 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-245a4059-d464-460b-b551-b7215b0cd70c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:22.172514 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-245a4059-d464-460b-b551-b7215b0cd70c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:22.181937 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-245a4059-d464-460b-b551-b7215b0cd70c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:22.182380 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-245a4059-d464-460b-b551-b7215b0cd70c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:22.183200 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-245a4059-d464-460b-b551-b7215b0cd70c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:22.183707 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-245a4059-d464-460b-b551-b7215b0cd70c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:22.327465 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-245a4059-d464-460b-b551-b7215b0cd70c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:22.335124 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-245a4059-d464-460b-b551-b7215b0cd70c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1677 microversion: 2.1 time: 0.172622 Jun 14 19:45:22.341960 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 251/473] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:22 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:45:22.490865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-fe157d0e-729b-4aad-b613-c1a4cf551349 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:22.503434 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-fe157d0e-729b-4aad-b613-c1a4cf551349 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1681 microversion: 2.1 time: 0.394831 Jun 14 19:45:22.504244 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 223/474] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:22 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1681 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:23.352107 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d7aab1a7-a020-479e-abbc-80e8950d4a1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:23.352722 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d7aab1a7-a020-479e-abbc-80e8950d4a1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:23.359244 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d7aab1a7-a020-479e-abbc-80e8950d4a1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:23.359691 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d7aab1a7-a020-479e-abbc-80e8950d4a1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:23.360458 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d7aab1a7-a020-479e-abbc-80e8950d4a1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:23.360896 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d7aab1a7-a020-479e-abbc-80e8950d4a1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:23.522370 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-7c4d1222-4873-4cfd-9b05-e247a712a529 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:23.523568 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-7c4d1222-4873-4cfd-9b05-e247a712a529 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:23.537738 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d7aab1a7-a020-479e-abbc-80e8950d4a1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:23.538619 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7c4d1222-4873-4cfd-9b05-e247a712a529 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:23.539245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7c4d1222-4873-4cfd-9b05-e247a712a529 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:23.540378 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7c4d1222-4873-4cfd-9b05-e247a712a529 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:23.541096 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7c4d1222-4873-4cfd-9b05-e247a712a529 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:23.550661 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d7aab1a7-a020-479e-abbc-80e8950d4a1f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1677 microversion: 2.1 time: 0.202228 Jun 14 19:45:23.551557 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 252/475] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:23 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1677 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:23.561117 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-5bfd6c81-4dac-4ef7-b330-ee8d447a85bb req-3f7ffe65-48dc-4262-bed4-850bda9ed250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2353fc-c6c0-4c56-8423-5bc7b343acc7", "name": "network-vif-deleted", "tag": "90b7f081-458d-4545-b9cc-146a82537268"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:23.582421 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-5bfd6c81-4dac-4ef7-b330-ee8d447a85bb req-3f7ffe65-48dc-4262-bed4-850bda9ed250 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:23.583303 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-5bfd6c81-4dac-4ef7-b330-ee8d447a85bb req-3f7ffe65-48dc-4262-bed4-850bda9ed250 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:23.604701 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-5bfd6c81-4dac-4ef7-b330-ee8d447a85bb req-3f7ffe65-48dc-4262-bed4-850bda9ed250 service nova] Creating event network-vif-deleted:90b7f081-458d-4545-b9cc-146a82537268 for instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 on hv-cinder-84580 Jun 14 19:45:23.619365 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-5bfd6c81-4dac-4ef7-b330-ee8d447a85bb req-3f7ffe65-48dc-4262-bed4-850bda9ed250 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062168 Jun 14 19:45:23.620320 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 253/476] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:45:23.697703 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-7c4d1222-4873-4cfd-9b05-e247a712a529 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:23.710761 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-7c4d1222-4873-4cfd-9b05-e247a712a529 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 200 len: 1613 microversion: 2.1 time: 0.193574 Jun 14 19:45:23.712123 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 224/477] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:23 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 1613 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:45:24.569296 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-aa6fb158-753f-4e11-a066-ee17716c50cd tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:24.570942 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-aa6fb158-753f-4e11-a066-ee17716c50cd tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:24.578070 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aa6fb158-753f-4e11-a066-ee17716c50cd tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:24.578870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aa6fb158-753f-4e11-a066-ee17716c50cd tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:24.580102 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aa6fb158-753f-4e11-a066-ee17716c50cd tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:24.581014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aa6fb158-753f-4e11-a066-ee17716c50cd tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:24.728431 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4b140cc1-c451-4e7e-af00-5da913394413 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:24.729960 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4b140cc1-c451-4e7e-af00-5da913394413 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:24.737224 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-aa6fb158-753f-4e11-a066-ee17716c50cd tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:24.738224 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4b140cc1-c451-4e7e-af00-5da913394413 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:24.739114 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4b140cc1-c451-4e7e-af00-5da913394413 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:24.740144 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4b140cc1-c451-4e7e-af00-5da913394413 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:24.740758 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4b140cc1-c451-4e7e-af00-5da913394413 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:24.747108 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-aa6fb158-753f-4e11-a066-ee17716c50cd tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1677 microversion: 2.1 time: 0.182017 Jun 14 19:45:24.758227 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 254/478] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:24 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:45:24.761495 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-4b140cc1-c451-4e7e-af00-5da913394413 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] HTTP exception thrown: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4b140cc1-c451-4e7e-af00-5da913394413 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Request method failure captured: Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 HTTP/1.1 Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSSLZpR2w_xFmfjar75tGJDU2sD62hg-I9tSk--QtfqjFSlliGkRH_W6CYwZ7Iph2aF4fxrjxzyeJzd_hl0QyZ4Pw-2UckaxY5_2H0QoR9Blg4BQM7Y5TpsnBrEMi60m5uD-Uzx7H-VX8XJXxLhIjXrvmJpguoa2gF4eYzoPZCLZyc Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:45:24.763183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:45:24.764789 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}] Jun 14 19:45:24.764789 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:45:24.764789 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:45:24.764789 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:45:24.764789 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:45:24.764789 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:45:24.764789 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:45:24.764789 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 323c51f037db4ecca2f66cb6e9879246 Jun 14 19:45:24.764789 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:45:24.764789 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:45:24.764789 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. Jun 14 19:45:24.764789 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '4e2353fc-c6c0-4c56-8423-5bc7b343acc7'} Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:45:24.765765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. Jun 14 19:45:24.767143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:45:24.769009 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4b140cc1-c451-4e7e-af00-5da913394413 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Returning 404 to user: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:45:24.769701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4b140cc1-c451-4e7e-af00-5da913394413 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 404 len: 111 microversion: 2.1 time: 0.045429 Jun 14 19:45:24.770358 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 225/479] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:24 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:45:24.779406 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-7ebf8015-31f8-443b-acb6-1d352a718e41 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '.version_select at 0x7f144adebca0>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:24.800811 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-7ebf8015-31f8-443b-acb6-1d352a718e41 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602562430" status: 202 len: 0 microversion: 2.1 time: 0.025315 Jun 14 19:45:24.805099 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 255/480] 10.222.0.44 () {58 vars in 1220 bytes} [Tue Jun 14 19:45:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602562430 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:45:25.539815 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8e01b7e5-0141-4bf8-835f-c7d3f86ffbe8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:25.540346 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8e01b7e5-0141-4bf8-835f-c7d3f86ffbe8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:25.546438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e01b7e5-0141-4bf8-835f-c7d3f86ffbe8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:25.546884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e01b7e5-0141-4bf8-835f-c7d3f86ffbe8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:25.547644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e01b7e5-0141-4bf8-835f-c7d3f86ffbe8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:25.548079 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e01b7e5-0141-4bf8-835f-c7d3f86ffbe8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:25.638252 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-9b85d647-59d4-4106-b39e-6f9e5f25dd59 req-6fc43212-4c5a-43b6-b077-2219434bf856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a0421fa-7df8-4d48-b112-fff79061f5ae", "tag": "04d8f989-9542-404e-a49a-add222e0ca49"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:25.647390 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-9b85d647-59d4-4106-b39e-6f9e5f25dd59 req-6fc43212-4c5a-43b6-b077-2219434bf856 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:25.647837 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-9b85d647-59d4-4106-b39e-6f9e5f25dd59 req-6fc43212-4c5a-43b6-b077-2219434bf856 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:25.665275 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-9b85d647-59d4-4106-b39e-6f9e5f25dd59 req-6fc43212-4c5a-43b6-b077-2219434bf856 service nova] Creating event network-changed:04d8f989-9542-404e-a49a-add222e0ca49 for instance 2a0421fa-7df8-4d48-b112-fff79061f5ae on hv-cinder-84580 Jun 14 19:45:25.672403 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-9b85d647-59d4-4106-b39e-6f9e5f25dd59 req-6fc43212-4c5a-43b6-b077-2219434bf856 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036685 Jun 14 19:45:25.673287 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 256/481] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:45:25.697631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.objects.instance [None req-8e01b7e5-0141-4bf8-835f-c7d3f86ffbe8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lazy-loading 'services' on Instance uuid f1434a82-cdbc-474b-95c4-44331ae4a084 {{(pid=124069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:45:25.765406 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-851d4fa6-6e3f-456c-998d-c6d1ab068a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:25.766174 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-851d4fa6-6e3f-456c-998d-c6d1ab068a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:25.772819 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-851d4fa6-6e3f-456c-998d-c6d1ab068a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:25.773383 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-851d4fa6-6e3f-456c-998d-c6d1ab068a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:25.774273 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-851d4fa6-6e3f-456c-998d-c6d1ab068a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:25.774711 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-851d4fa6-6e3f-456c-998d-c6d1ab068a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:25.779267 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:25.829565 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8e01b7e5-0141-4bf8-835f-c7d3f86ffbe8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084/os-volume_attachments/09e61fce-e4b1-4ce3-9bd5-7528fa8b7f5b" status: 202 len: 0 microversion: 2.1 time: 0.293459 Jun 14 19:45:25.830511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 226/482] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 14 19:45:25 2022] DELETE /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084/os-volume_attachments/09e61fce-e4b1-4ce3-9bd5-7528fa8b7f5b => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:45:25.839077 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-f9270557-65c0-472d-8008-8e67019f112b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:25.840259 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-f9270557-65c0-472d-8008-8e67019f112b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:25.848038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f9270557-65c0-472d-8008-8e67019f112b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:25.848852 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f9270557-65c0-472d-8008-8e67019f112b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:25.849703 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f9270557-65c0-472d-8008-8e67019f112b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:25.850353 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f9270557-65c0-472d-8008-8e67019f112b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:25.886197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-f9270557-65c0-472d-8008-8e67019f112b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051412 Jun 14 19:45:25.887718 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 227/483] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:45:25 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:45:25.949889 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-851d4fa6-6e3f-456c-998d-c6d1ab068a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:25.957702 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-851d4fa6-6e3f-456c-998d-c6d1ab068a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1677 microversion: 2.1 time: 0.197197 Jun 14 19:45:25.963322 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 257/484] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:25 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1677 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:26.898989 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9e0d59e7-84bf-4213-bdf5-d15442c2305b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:26.899942 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9e0d59e7-84bf-4213-bdf5-d15442c2305b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:26.907207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9e0d59e7-84bf-4213-bdf5-d15442c2305b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:26.907653 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9e0d59e7-84bf-4213-bdf5-d15442c2305b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:26.908460 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9e0d59e7-84bf-4213-bdf5-d15442c2305b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:26.908843 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9e0d59e7-84bf-4213-bdf5-d15442c2305b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:26.934122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:26.938820 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9e0d59e7-84bf-4213-bdf5-d15442c2305b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043761 Jun 14 19:45:26.939380 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 228/485] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:45:26 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 19:45:26.974658 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b975135c-cb37-4aba-a753-332353769a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:26.975264 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b975135c-cb37-4aba-a753-332353769a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:26.984984 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b975135c-cb37-4aba-a753-332353769a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:26.985560 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b975135c-cb37-4aba-a753-332353769a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:26.986395 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b975135c-cb37-4aba-a753-332353769a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:26.986913 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b975135c-cb37-4aba-a753-332353769a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:26.995812 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-0df394ab-e05e-4259-b2e8-ed2e7a568e58 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:26.996313 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-0df394ab-e05e-4259-b2e8-ed2e7a568e58 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:27.003982 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0df394ab-e05e-4259-b2e8-ed2e7a568e58 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:27.004434 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0df394ab-e05e-4259-b2e8-ed2e7a568e58 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:27.005199 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0df394ab-e05e-4259-b2e8-ed2e7a568e58 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:27.005655 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0df394ab-e05e-4259-b2e8-ed2e7a568e58 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:27.031984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-0df394ab-e05e-4259-b2e8-ed2e7a568e58 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Going to try to terminate instance {{(pid=124069) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:45:27.110203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-0df394ab-e05e-4259-b2e8-ed2e7a568e58 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 204 len: 0 microversion: 2.1 time: 0.117824 Jun 14 19:45:27.110855 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 229/486] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:45:26 2022] DELETE /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 14 19:45:27.119274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-05c7e432-a9aa-4011-ab54-14e8770d8475 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:27.120040 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-05c7e432-a9aa-4011-ab54-14e8770d8475 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:27.122714 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b975135c-cb37-4aba-a753-332353769a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:27.126945 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-05c7e432-a9aa-4011-ab54-14e8770d8475 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:27.127388 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-05c7e432-a9aa-4011-ab54-14e8770d8475 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:27.128155 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-05c7e432-a9aa-4011-ab54-14e8770d8475 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:27.128604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-05c7e432-a9aa-4011-ab54-14e8770d8475 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:27.131296 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b975135c-cb37-4aba-a753-332353769a13 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1677 microversion: 2.1 time: 0.160364 Jun 14 19:45:27.140023 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 258/487] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:26 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:27.255972 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-05c7e432-a9aa-4011-ab54-14e8770d8475 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:27.263356 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-05c7e432-a9aa-4011-ab54-14e8770d8475 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1678 microversion: 2.1 time: 0.148360 Jun 14 19:45:27.263915 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 230/488] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:27 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:45:28.148204 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a732b38b-a6b1-485c-ac11-9538088e9b2d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:28.148721 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a732b38b-a6b1-485c-ac11-9538088e9b2d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:28.155147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a732b38b-a6b1-485c-ac11-9538088e9b2d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:28.155594 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a732b38b-a6b1-485c-ac11-9538088e9b2d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:28.156342 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a732b38b-a6b1-485c-ac11-9538088e9b2d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:28.156768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a732b38b-a6b1-485c-ac11-9538088e9b2d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:28.280229 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-dc580a8f-cca3-4119-a400-4e850dd6493c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:28.280844 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-dc580a8f-cca3-4119-a400-4e850dd6493c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:28.286782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a732b38b-a6b1-485c-ac11-9538088e9b2d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:28.287526 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dc580a8f-cca3-4119-a400-4e850dd6493c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:28.287970 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dc580a8f-cca3-4119-a400-4e850dd6493c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:28.288735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dc580a8f-cca3-4119-a400-4e850dd6493c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:28.289166 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dc580a8f-cca3-4119-a400-4e850dd6493c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:28.294308 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a732b38b-a6b1-485c-ac11-9538088e9b2d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1677 microversion: 2.1 time: 0.149960 Jun 14 19:45:28.294862 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 259/489] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:28 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:28.420704 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-dc580a8f-cca3-4119-a400-4e850dd6493c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:28.428913 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-dc580a8f-cca3-4119-a400-4e850dd6493c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1678 microversion: 2.1 time: 0.152739 Jun 14 19:45:28.429495 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 231/490] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:28 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:45:29.311667 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-5879f60f-a32e-45aa-bc2c-2f411e466935 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:29.312274 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-5879f60f-a32e-45aa-bc2c-2f411e466935 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:29.319114 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5879f60f-a32e-45aa-bc2c-2f411e466935 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:29.319560 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5879f60f-a32e-45aa-bc2c-2f411e466935 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:29.320322 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5879f60f-a32e-45aa-bc2c-2f411e466935 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:29.320752 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5879f60f-a32e-45aa-bc2c-2f411e466935 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:29.445908 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-538b1911-973f-4691-a541-f0ea0aa23537 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:29.446544 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-538b1911-973f-4691-a541-f0ea0aa23537 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:29.454118 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-538b1911-973f-4691-a541-f0ea0aa23537 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:29.455301 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-538b1911-973f-4691-a541-f0ea0aa23537 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:29.456700 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-538b1911-973f-4691-a541-f0ea0aa23537 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:29.457212 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-538b1911-973f-4691-a541-f0ea0aa23537 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:29.460710 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-5879f60f-a32e-45aa-bc2c-2f411e466935 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:29.469687 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-5879f60f-a32e-45aa-bc2c-2f411e466935 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1677 microversion: 2.1 time: 0.161636 Jun 14 19:45:29.479264 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 260/491] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:29 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:29.554770 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-538b1911-973f-4691-a541-f0ea0aa23537 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:29.562316 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-538b1911-973f-4691-a541-f0ea0aa23537 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 200 len: 1611 microversion: 2.1 time: 0.120192 Jun 14 19:45:29.563463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 232/492] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:29 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 1611 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:45:29.772640 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-be3171fd-b2dd-4ecd-8db0-8bb72ceb5f07 req-3a88b069-93ac-4e65-868e-168f25ca109b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1434a82-cdbc-474b-95c4-44331ae4a084", "name": "network-vif-deleted", "tag": "9ccf27ae-101e-466d-957e-384dd10e0dbb"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:29.783160 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-be3171fd-b2dd-4ecd-8db0-8bb72ceb5f07 req-3a88b069-93ac-4e65-868e-168f25ca109b service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:29.783771 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-be3171fd-b2dd-4ecd-8db0-8bb72ceb5f07 req-3a88b069-93ac-4e65-868e-168f25ca109b service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:29.798563 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-be3171fd-b2dd-4ecd-8db0-8bb72ceb5f07 req-3a88b069-93ac-4e65-868e-168f25ca109b service nova] Creating event network-vif-deleted:9ccf27ae-101e-466d-957e-384dd10e0dbb for instance f1434a82-cdbc-474b-95c4-44331ae4a084 on hv-cinder-84580 Jun 14 19:45:29.806368 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-be3171fd-b2dd-4ecd-8db0-8bb72ceb5f07 req-3a88b069-93ac-4e65-868e-168f25ca109b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036691 Jun 14 19:45:29.807809 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 261/493] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:45:30.487169 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-438b013e-1fa0-4202-bd63-23d85ced2189 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:30.487743 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-438b013e-1fa0-4202-bd63-23d85ced2189 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:30.494424 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-438b013e-1fa0-4202-bd63-23d85ced2189 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:30.494866 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-438b013e-1fa0-4202-bd63-23d85ced2189 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:30.495623 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-438b013e-1fa0-4202-bd63-23d85ced2189 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:30.496053 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-438b013e-1fa0-4202-bd63-23d85ced2189 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:30.581787 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c147d326-c559-42d2-8180-c373d005fa8a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:30.582417 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c147d326-c559-42d2-8180-c373d005fa8a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:30.588931 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c147d326-c559-42d2-8180-c373d005fa8a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:30.589402 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c147d326-c559-42d2-8180-c373d005fa8a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:30.590326 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c147d326-c559-42d2-8180-c373d005fa8a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:30.590767 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c147d326-c559-42d2-8180-c373d005fa8a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:30.605942 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-c147d326-c559-42d2-8180-c373d005fa8a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] HTTP exception thrown: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c147d326-c559-42d2-8180-c373d005fa8a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Request method failure captured: Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 HTTP/1.1 Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOSSLZpR2w_xFmfjar75tGJDU2sD62hg-I9tSk--QtfqjFSlliGkRH_W6CYwZ7Iph2aF4fxrjxzyeJzd_hl0QyZ4Pw-2UckaxY5_2H0QoR9Blg4BQM7Y5TpsnBrEMi60m5uD-Uzx7H-VX8XJXxLhIjXrvmJpguoa2gF4eYzoPZCLZyc Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:45:30.607660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:45:30.609245 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}] Jun 14 19:45:30.609245 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:45:30.609245 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:45:30.609245 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:45:30.609245 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:45:30.609245 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:45:30.609245 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:45:30.609245 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 323c51f037db4ecca2f66cb6e9879246 Jun 14 19:45:30.609245 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:45:30.609245 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:45:30.609245 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. Jun 14 19:45:30.609245 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': 'f1434a82-cdbc-474b-95c4-44331ae4a084'} Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:45:30.610351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. Jun 14 19:45:30.611542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:45:30.612614 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c147d326-c559-42d2-8180-c373d005fa8a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Returning 404 to user: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:45:30.612614 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c147d326-c559-42d2-8180-c373d005fa8a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 404 len: 111 microversion: 2.1 time: 0.032749 Jun 14 19:45:30.612614 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 262/494] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:30 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 19:45:30.618318 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-443e9f1e-25ba-4f0b-8af1-ba691fa6f143 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '.version_select at 0x7f144afac1f0>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:30.639532 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-443e9f1e-25ba-4f0b-8af1-ba691fa6f143 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-137193103" status: 202 len: 0 microversion: 2.1 time: 0.025108 Jun 14 19:45:30.640446 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 263/495] 10.222.0.44 () {58 vars in 1217 bytes} [Tue Jun 14 19:45:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-137193103 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:45:30.645994 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-438b013e-1fa0-4202-bd63-23d85ced2189 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:30.654455 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-438b013e-1fa0-4202-bd63-23d85ced2189 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1677 microversion: 2.1 time: 0.171701 Jun 14 19:45:30.664948 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 233/496] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:30 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:31.487310 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-7d6846a1-2b13-4d1a-a603-0b3807052d67 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Action: 'create', calling method: .version_select at 0x7f144af77af0>, body: {"keypair": {"name": "tempest-keypair-1890003777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRO66P5Su940384V2faXrkmQ8kJBFwT2++0A/XjnaPUNJfKAPX1wSetJt8A3ONM8C/vfZtlSHH1rb4/3nUOow1TF73y6R/Vc83q72frTORtXfSDwjph78UpCEJJvLPw4g=="}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:31.501758 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-7d6846a1-2b13-4d1a-a603-0b3807052d67 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:45:31.505524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-7d6846a1-2b13-4d1a-a603-0b3807052d67 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for user 323c51f037db4ecca2f66cb6e9879246 and project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:45:31.526061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-7d6846a1-2b13-4d1a-a603-0b3807052d67 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043435 Jun 14 19:45:31.526633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 264/497] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 14 19:45:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:45:31.674375 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-dbd9cfef-a26a-4f68-a363-23a1c8c459c6 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:31.675013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-dbd9cfef-a26a-4f68-a363-23a1c8c459c6 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:31.689629 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dbd9cfef-a26a-4f68-a363-23a1c8c459c6 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:31.690076 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dbd9cfef-a26a-4f68-a363-23a1c8c459c6 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:31.690849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dbd9cfef-a26a-4f68-a363-23a1c8c459c6 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:31.691280 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dbd9cfef-a26a-4f68-a363-23a1c8c459c6 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:31.829904 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-dbd9cfef-a26a-4f68-a363-23a1c8c459c6 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:31.838543 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-dbd9cfef-a26a-4f68-a363-23a1c8c459c6 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1677 microversion: 2.1 time: 0.170477 Jun 14 19:45:31.839329 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 234/498] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:31 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:32.824329 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1594380535", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "810afb1c-546b-4676-b2eb-077f19735ed6"}], "security_groups": [{"name": "tempest-securitygroup--1755716669"}], "key_name": "tempest-keypair-1890003777", "user_data": "}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:32.856068 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-f21303fc-404c-4ab4-857c-43ae3cf9877d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:32.856682 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-f21303fc-404c-4ab4-857c-43ae3cf9877d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:32.864548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f21303fc-404c-4ab4-857c-43ae3cf9877d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:32.865007 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f21303fc-404c-4ab4-857c-43ae3cf9877d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:32.866085 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f21303fc-404c-4ab4-857c-43ae3cf9877d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:32.866232 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f21303fc-404c-4ab4-857c-43ae3cf9877d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:32.927091 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.network.neutron [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] validate_networks() for [('810afb1c-546b-4676-b2eb-077f19735ed6', None, None, None, None, None)] {{(pid=124068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:45:32.996030 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-f21303fc-404c-4ab4-857c-43ae3cf9877d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:33.003683 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-f21303fc-404c-4ab4-857c-43ae3cf9877d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1654 microversion: 2.1 time: 0.151645 Jun 14 19:45:33.004258 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 235/499] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:32 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:45:33.019392 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1ae776d8-c2cd-4eeb-b29e-d526b90aa88f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:33.025251 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1ae776d8-c2cd-4eeb-b29e-d526b90aa88f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:33.025740 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1ae776d8-c2cd-4eeb-b29e-d526b90aa88f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:33.050556 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-1ae776d8-c2cd-4eeb-b29e-d526b90aa88f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Going to try to start instance {{(pid=124069) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 14 19:45:33.094873 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-1ae776d8-c2cd-4eeb-b29e-d526b90aa88f tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "POST /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/action" status: 202 len: 0 microversion: 2.1 time: 0.078810 Jun 14 19:45:33.095481 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 236/500] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 14 19:45:33 2022] POST /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 19:45:33.103881 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-0373a615-29b9-4636-af22-bf38b457553e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:33.104584 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-0373a615-29b9-4636-af22-bf38b457553e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:33.111519 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0373a615-29b9-4636-af22-bf38b457553e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:33.111972 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0373a615-29b9-4636-af22-bf38b457553e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:33.112924 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0373a615-29b9-4636-af22-bf38b457553e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:33.113366 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0373a615-29b9-4636-af22-bf38b457553e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:33.304336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-0373a615-29b9-4636-af22-bf38b457553e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:33.312635 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-0373a615-29b9-4636-af22-bf38b457553e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1663 microversion: 2.1 time: 0.212683 Jun 14 19:45:33.313601 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 237/501] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:33 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1663 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:45:33.317742 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Flavor limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:45:33.318174 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Image limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:45:33.318654 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Flavor pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:45:33.319073 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Image pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:45:33.319488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:45:33.332948 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:33.333723 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:33.334854 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:33.335293 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:33.353650 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:45:33.357761 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for user 323c51f037db4ecca2f66cb6e9879246 and project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:45:33.368928 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Going to run 1 instances... {{(pid=124068) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:45:33.371249 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:45:33.422832 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3d0c8b63-0aeb-435c-a59a-63127160ff4f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.602726 Jun 14 19:45:33.423760 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 265/502] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:45:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:45:33.434243 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6e64eb65-23d8-4124-ac7c-1f1ab837aac2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:33.435092 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-6e64eb65-23d8-4124-ac7c-1f1ab837aac2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:33.522492 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-6e64eb65-23d8-4124-ac7c-1f1ab837aac2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:33.531116 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6e64eb65-23d8-4124-ac7c-1f1ab837aac2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1242 microversion: 2.1 time: 0.100303 Jun 14 19:45:33.541366 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 238/503] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:33 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:45:34.330813 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-db5d5877-cf3b-4479-94bb-3782849bafcb tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:34.331346 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-db5d5877-cf3b-4479-94bb-3782849bafcb tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:34.337368 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-db5d5877-cf3b-4479-94bb-3782849bafcb tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:34.337846 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-db5d5877-cf3b-4479-94bb-3782849bafcb tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:34.338608 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-db5d5877-cf3b-4479-94bb-3782849bafcb tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:34.339043 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-db5d5877-cf3b-4479-94bb-3782849bafcb tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:34.468498 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-db5d5877-cf3b-4479-94bb-3782849bafcb tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:34.476366 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-db5d5877-cf3b-4479-94bb-3782849bafcb tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1663 microversion: 2.1 time: 0.150053 Jun 14 19:45:34.476941 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 266/504] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:34 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:34.548193 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1e068482-caad-4009-8d72-447855d8555b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:34.548783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-1e068482-caad-4009-8d72-447855d8555b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:34.555920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1e068482-caad-4009-8d72-447855d8555b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:34.556370 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1e068482-caad-4009-8d72-447855d8555b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:34.557131 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1e068482-caad-4009-8d72-447855d8555b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:34.557637 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1e068482-caad-4009-8d72-447855d8555b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:34.618400 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-1e068482-caad-4009-8d72-447855d8555b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:34.625864 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-1e068482-caad-4009-8d72-447855d8555b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1302 microversion: 2.1 time: 0.082237 Jun 14 19:45:34.626419 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 239/505] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:34 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1302 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:35.494495 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-acc7d070-1ca0-4bf2-ae05-23380bbb6d6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:35.495104 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-acc7d070-1ca0-4bf2-ae05-23380bbb6d6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:35.501360 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-acc7d070-1ca0-4bf2-ae05-23380bbb6d6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:35.501838 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-acc7d070-1ca0-4bf2-ae05-23380bbb6d6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:35.502598 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-acc7d070-1ca0-4bf2-ae05-23380bbb6d6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:35.503042 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-acc7d070-1ca0-4bf2-ae05-23380bbb6d6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:35.636646 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-acc7d070-1ca0-4bf2-ae05-23380bbb6d6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:35.645880 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-acc7d070-1ca0-4bf2-ae05-23380bbb6d6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1667 microversion: 2.1 time: 0.155232 Jun 14 19:45:35.646450 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 267/506] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:35 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:35.647690 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-55b1ff63-5b05-4e3b-b933-28cb1d7d8baa tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:35.648889 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-55b1ff63-5b05-4e3b-b933-28cb1d7d8baa tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:35.656324 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-55b1ff63-5b05-4e3b-b933-28cb1d7d8baa tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:35.656971 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-55b1ff63-5b05-4e3b-b933-28cb1d7d8baa tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:35.657975 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-55b1ff63-5b05-4e3b-b933-28cb1d7d8baa tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:35.658485 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-55b1ff63-5b05-4e3b-b933-28cb1d7d8baa tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:35.904277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-55b1ff63-5b05-4e3b-b933-28cb1d7d8baa tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:35.912899 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-55b1ff63-5b05-4e3b-b933-28cb1d7d8baa tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1368 microversion: 2.1 time: 0.270016 Jun 14 19:45:35.913497 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 240/507] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:35 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1368 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:36.503965 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-5a381edb-81cb-4333-b60d-4d46ae61f5f1 req-5a2873f8-69f6-449d-ab86-61f143f3f462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5bae0a1-ab48-4943-95c1-bf124010357a", "tag": "2ec77f05-bca9-42c5-b5cb-ac9e70a0f2f6"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:36.516902 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-5a381edb-81cb-4333-b60d-4d46ae61f5f1 req-5a2873f8-69f6-449d-ab86-61f143f3f462 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:36.517623 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-5a381edb-81cb-4333-b60d-4d46ae61f5f1 req-5a2873f8-69f6-449d-ab86-61f143f3f462 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:36.533356 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-5a381edb-81cb-4333-b60d-4d46ae61f5f1 req-5a2873f8-69f6-449d-ab86-61f143f3f462 service nova] Creating event network-changed:2ec77f05-bca9-42c5-b5cb-ac9e70a0f2f6 for instance c5bae0a1-ab48-4943-95c1-bf124010357a on hv-cinder-84580 Jun 14 19:45:36.538570 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-5a381edb-81cb-4333-b60d-4d46ae61f5f1 req-5a2873f8-69f6-449d-ab86-61f143f3f462 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038295 Jun 14 19:45:36.539677 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 268/508] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:45:36.930213 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-01b87868-ed07-456f-8628-041912c213a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:36.930830 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-01b87868-ed07-456f-8628-041912c213a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:36.938484 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-01b87868-ed07-456f-8628-041912c213a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:36.938691 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-01b87868-ed07-456f-8628-041912c213a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:36.939465 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-01b87868-ed07-456f-8628-041912c213a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:36.939902 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-01b87868-ed07-456f-8628-041912c213a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:37.069258 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-01b87868-ed07-456f-8628-041912c213a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:37.076639 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-01b87868-ed07-456f-8628-041912c213a6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1368 microversion: 2.1 time: 0.150376 Jun 14 19:45:37.077224 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 241/509] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:36 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:37.085957 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d5baaea5-0ae9-42f3-9081-07808416c4d3 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16370e04-a042-4267-8841-f5fe24864181"}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:37.087085 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d5baaea5-0ae9-42f3-9081-07808416c4d3 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:37.094077 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d5baaea5-0ae9-42f3-9081-07808416c4d3 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:37.094536 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d5baaea5-0ae9-42f3-9081-07808416c4d3 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:37.095417 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d5baaea5-0ae9-42f3-9081-07808416c4d3 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:37.095855 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d5baaea5-0ae9-42f3-9081-07808416c4d3 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:38.094557 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-626da92d-2ef7-4d8b-8b1a-16b4ce1d59a2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:38.095321 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-626da92d-2ef7-4d8b-8b1a-16b4ce1d59a2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:38.102179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-626da92d-2ef7-4d8b-8b1a-16b4ce1d59a2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:38.102717 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-626da92d-2ef7-4d8b-8b1a-16b4ce1d59a2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:38.103575 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-626da92d-2ef7-4d8b-8b1a-16b4ce1d59a2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:38.104092 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-626da92d-2ef7-4d8b-8b1a-16b4ce1d59a2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:38.157997 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d5baaea5-0ae9-42f3-9081-07808416c4d3 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "POST /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.075807 Jun 14 19:45:38.163283 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 269/510] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 14 19:45:37 2022] POST /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/os-volume_attachments => generated 194 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:45:38.336707 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-626da92d-2ef7-4d8b-8b1a-16b4ce1d59a2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:38.344975 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-626da92d-2ef7-4d8b-8b1a-16b4ce1d59a2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1368 microversion: 2.1 time: 0.254876 Jun 14 19:45:38.345537 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 242/511] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:38 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:45:39.362666 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1894ec63-d952-483d-8480-3597d7b847b6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:39.363358 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1894ec63-d952-483d-8480-3597d7b847b6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:39.370011 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1894ec63-d952-483d-8480-3597d7b847b6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:39.370453 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1894ec63-d952-483d-8480-3597d7b847b6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:39.371197 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1894ec63-d952-483d-8480-3597d7b847b6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:39.371624 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1894ec63-d952-483d-8480-3597d7b847b6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:39.498590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1894ec63-d952-483d-8480-3597d7b847b6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:39.505898 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1894ec63-d952-483d-8480-3597d7b847b6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1368 microversion: 2.1 time: 0.148092 Jun 14 19:45:39.506448 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 270/512] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:39 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:40.522345 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4851da0b-4e43-440e-a278-0010e37fec0e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:40.523027 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4851da0b-4e43-440e-a278-0010e37fec0e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:40.532317 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4851da0b-4e43-440e-a278-0010e37fec0e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:40.532762 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4851da0b-4e43-440e-a278-0010e37fec0e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:40.533685 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4851da0b-4e43-440e-a278-0010e37fec0e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:40.534116 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4851da0b-4e43-440e-a278-0010e37fec0e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:40.676158 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4851da0b-4e43-440e-a278-0010e37fec0e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:40.678555 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:40.685769 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4851da0b-4e43-440e-a278-0010e37fec0e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1368 microversion: 2.1 time: 0.167629 Jun 14 19:45:40.686354 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 243/513] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:40 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:41.702146 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-81f7a377-eb49-45c1-8418-212c6d2b3b10 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:41.703273 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-81f7a377-eb49-45c1-8418-212c6d2b3b10 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:41.709755 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-81f7a377-eb49-45c1-8418-212c6d2b3b10 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:41.710205 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-81f7a377-eb49-45c1-8418-212c6d2b3b10 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:41.710965 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-81f7a377-eb49-45c1-8418-212c6d2b3b10 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:41.711403 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-81f7a377-eb49-45c1-8418-212c6d2b3b10 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:41.838087 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-81f7a377-eb49-45c1-8418-212c6d2b3b10 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:41.845925 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-81f7a377-eb49-45c1-8418-212c6d2b3b10 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1368 microversion: 2.1 time: 0.147672 Jun 14 19:45:41.846484 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 271/514] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:41 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:42.313447 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-6b032c4e-6e9b-4680-bac0-ac2732193846 req-a6cad491-8aae-484b-b218-6eb9d6fab907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5bae0a1-ab48-4943-95c1-bf124010357a", "name": "network-vif-plugged", "status": "completed", "tag": "2ec77f05-bca9-42c5-b5cb-ac9e70a0f2f6"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:42.322647 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-6b032c4e-6e9b-4680-bac0-ac2732193846 req-a6cad491-8aae-484b-b218-6eb9d6fab907 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:42.323086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-6b032c4e-6e9b-4680-bac0-ac2732193846 req-a6cad491-8aae-484b-b218-6eb9d6fab907 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:42.334607 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-6b032c4e-6e9b-4680-bac0-ac2732193846 req-a6cad491-8aae-484b-b218-6eb9d6fab907 service nova] Creating event network-vif-plugged:2ec77f05-bca9-42c5-b5cb-ac9e70a0f2f6 for instance c5bae0a1-ab48-4943-95c1-bf124010357a on hv-cinder-84580 Jun 14 19:45:42.339384 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-6b032c4e-6e9b-4680-bac0-ac2732193846 req-a6cad491-8aae-484b-b218-6eb9d6fab907 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030097 Jun 14 19:45:42.339963 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 244/515] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:45:42.863415 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-057457af-4576-464a-b8e1-57553df0032b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:42.864047 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-057457af-4576-464a-b8e1-57553df0032b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:42.870543 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-057457af-4576-464a-b8e1-57553df0032b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:42.870981 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-057457af-4576-464a-b8e1-57553df0032b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:42.871727 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-057457af-4576-464a-b8e1-57553df0032b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:42.872153 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-057457af-4576-464a-b8e1-57553df0032b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:43.004962 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-057457af-4576-464a-b8e1-57553df0032b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:43.012301 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-057457af-4576-464a-b8e1-57553df0032b tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1368 microversion: 2.1 time: 0.153691 Jun 14 19:45:43.012851 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 272/516] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:42 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:44.027824 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:44.031991 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-02a9685f-dfd4-41a5-99a4-5947c20780ed tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:44.032674 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-02a9685f-dfd4-41a5-99a4-5947c20780ed tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:44.039119 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-02a9685f-dfd4-41a5-99a4-5947c20780ed tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:44.039561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-02a9685f-dfd4-41a5-99a4-5947c20780ed tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:44.040318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-02a9685f-dfd4-41a5-99a4-5947c20780ed tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:44.040748 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-02a9685f-dfd4-41a5-99a4-5947c20780ed tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:44.170857 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-02a9685f-dfd4-41a5-99a4-5947c20780ed tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:44.178832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-02a9685f-dfd4-41a5-99a4-5947c20780ed tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1368 microversion: 2.1 time: 0.152738 Jun 14 19:45:44.179399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 245/517] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:44 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:45.194470 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-50162f0b-74fe-44db-996e-ca8885da20f9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:45.195106 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-50162f0b-74fe-44db-996e-ca8885da20f9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:45.197016 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:45.197695 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=10 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:45.198788 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:45.205473 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-50162f0b-74fe-44db-996e-ca8885da20f9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:45.205922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-50162f0b-74fe-44db-996e-ca8885da20f9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:45.206673 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-50162f0b-74fe-44db-996e-ca8885da20f9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:45.207103 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-50162f0b-74fe-44db-996e-ca8885da20f9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:45.343927 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-50162f0b-74fe-44db-996e-ca8885da20f9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:45.352546 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-50162f0b-74fe-44db-996e-ca8885da20f9 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1557 microversion: 2.1 time: 0.161854 Jun 14 19:45:45.353116 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 273/518] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:45 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:45.368901 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-caaf1bcd-b658-454a-bfad-0f17781f0755 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:45.369477 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-caaf1bcd-b658-454a-bfad-0f17781f0755 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:45.376073 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-caaf1bcd-b658-454a-bfad-0f17781f0755 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:45.376518 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-caaf1bcd-b658-454a-bfad-0f17781f0755 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:45.377387 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-caaf1bcd-b658-454a-bfad-0f17781f0755 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:45.377854 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-caaf1bcd-b658-454a-bfad-0f17781f0755 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:45.459209 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-caaf1bcd-b658-454a-bfad-0f17781f0755 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094023 Jun 14 19:45:45.459794 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 246/519] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 14 19:45:45 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:45:45.666301 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-2322e932-3dc6-45f9-b897-c38961a6e8c7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:45.667310 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-2322e932-3dc6-45f9-b897-c38961a6e8c7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:45.673429 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2322e932-3dc6-45f9-b897-c38961a6e8c7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:45.673922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2322e932-3dc6-45f9-b897-c38961a6e8c7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:45.674701 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2322e932-3dc6-45f9-b897-c38961a6e8c7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:45.675140 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2322e932-3dc6-45f9-b897-c38961a6e8c7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:45.699400 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.objects.instance [None req-2322e932-3dc6-45f9-b897-c38961a6e8c7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lazy-loading 'flavor' on Instance uuid e845044c-b4e8-462f-abf8-0301476ec285 {{(pid=124068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:45:45.834226 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-2322e932-3dc6-45f9-b897-c38961a6e8c7 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "POST /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/action" status: 200 len: 32 microversion: 2.1 time: 0.172284 Jun 14 19:45:45.835019 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 274/520] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 14 19:45:45 2022] POST /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 19:45:45.844825 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-220999e1-5f62-4d2d-8546-b6f09cd9b43e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:45.845580 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-220999e1-5f62-4d2d-8546-b6f09cd9b43e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:45.852228 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-220999e1-5f62-4d2d-8546-b6f09cd9b43e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:45.852681 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-220999e1-5f62-4d2d-8546-b6f09cd9b43e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:45.853498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-220999e1-5f62-4d2d-8546-b6f09cd9b43e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:45.853931 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-220999e1-5f62-4d2d-8546-b6f09cd9b43e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:46.413895 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-220999e1-5f62-4d2d-8546-b6f09cd9b43e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:46.422436 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-220999e1-5f62-4d2d-8546-b6f09cd9b43e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.582379 Jun 14 19:45:46.423004 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 247/521] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:45 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:47.057944 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-e8b3b851-ee8a-4477-971b-e35b2cb4228d req-8c0290ec-f8ae-4d20-82a3-ac43c00ff0ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5bae0a1-ab48-4943-95c1-bf124010357a", "tag": "2ec77f05-bca9-42c5-b5cb-ac9e70a0f2f6"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:45:47.078708 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-e8b3b851-ee8a-4477-971b-e35b2cb4228d req-8c0290ec-f8ae-4d20-82a3-ac43c00ff0ff service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:47.079452 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-e8b3b851-ee8a-4477-971b-e35b2cb4228d req-8c0290ec-f8ae-4d20-82a3-ac43c00ff0ff service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:47.090816 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:47.093455 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-e8b3b851-ee8a-4477-971b-e35b2cb4228d req-8c0290ec-f8ae-4d20-82a3-ac43c00ff0ff service nova] Creating event network-changed:2ec77f05-bca9-42c5-b5cb-ac9e70a0f2f6 for instance c5bae0a1-ab48-4943-95c1-bf124010357a on hv-cinder-84580 Jun 14 19:45:47.099780 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-e8b3b851-ee8a-4477-971b-e35b2cb4228d req-8c0290ec-f8ae-4d20-82a3-ac43c00ff0ff service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045769 Jun 14 19:45:47.100408 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 275/522] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:45:47.440193 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ab6ee953-de17-446c-be21-7743bed26b8d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:47.440972 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ab6ee953-de17-446c-be21-7743bed26b8d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:47.447823 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ab6ee953-de17-446c-be21-7743bed26b8d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:47.448278 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ab6ee953-de17-446c-be21-7743bed26b8d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:47.449052 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ab6ee953-de17-446c-be21-7743bed26b8d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:47.449512 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ab6ee953-de17-446c-be21-7743bed26b8d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:47.668224 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-ab6ee953-de17-446c-be21-7743bed26b8d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:47.677807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-ab6ee953-de17-446c-be21-7743bed26b8d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.242190 Jun 14 19:45:47.678380 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 248/523] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:47 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:48.696256 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-cc50ff0c-1a21-4b3a-9df9-22569f98ac7f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:48.696953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-cc50ff0c-1a21-4b3a-9df9-22569f98ac7f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:48.704816 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cc50ff0c-1a21-4b3a-9df9-22569f98ac7f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:48.705261 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cc50ff0c-1a21-4b3a-9df9-22569f98ac7f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:48.706043 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cc50ff0c-1a21-4b3a-9df9-22569f98ac7f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:48.706483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cc50ff0c-1a21-4b3a-9df9-22569f98ac7f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:48.838741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-cc50ff0c-1a21-4b3a-9df9-22569f98ac7f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:48.846593 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-cc50ff0c-1a21-4b3a-9df9-22569f98ac7f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.155373 Jun 14 19:45:48.847153 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 276/524] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:48 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:49.864449 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-59c38528-d839-4fa1-bdf1-f3949b334ec1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:49.865061 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-59c38528-d839-4fa1-bdf1-f3949b334ec1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:49.867433 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:49.872747 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-59c38528-d839-4fa1-bdf1-f3949b334ec1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:49.873200 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-59c38528-d839-4fa1-bdf1-f3949b334ec1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:49.873990 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-59c38528-d839-4fa1-bdf1-f3949b334ec1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:49.874426 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-59c38528-d839-4fa1-bdf1-f3949b334ec1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:50.002485 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-59c38528-d839-4fa1-bdf1-f3949b334ec1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:50.010287 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-59c38528-d839-4fa1-bdf1-f3949b334ec1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.149721 Jun 14 19:45:50.010842 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 249/525] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:49 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:51.027411 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-579891db-ad93-4d5a-b86f-32c3f74010d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:51.028028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-579891db-ad93-4d5a-b86f-32c3f74010d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:51.035224 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-579891db-ad93-4d5a-b86f-32c3f74010d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:51.035668 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-579891db-ad93-4d5a-b86f-32c3f74010d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:51.036428 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-579891db-ad93-4d5a-b86f-32c3f74010d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:51.036866 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-579891db-ad93-4d5a-b86f-32c3f74010d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:51.168399 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-579891db-ad93-4d5a-b86f-32c3f74010d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:51.176857 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-579891db-ad93-4d5a-b86f-32c3f74010d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.153574 Jun 14 19:45:51.177433 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 277/526] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:51 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:52.194532 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-351355f2-bccf-4537-be7a-37ce996bbe87 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:52.195061 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-351355f2-bccf-4537-be7a-37ce996bbe87 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:52.202013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-351355f2-bccf-4537-be7a-37ce996bbe87 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:52.202458 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-351355f2-bccf-4537-be7a-37ce996bbe87 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:52.203210 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-351355f2-bccf-4537-be7a-37ce996bbe87 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:52.203669 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-351355f2-bccf-4537-be7a-37ce996bbe87 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:52.330576 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-351355f2-bccf-4537-be7a-37ce996bbe87 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:52.338366 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-351355f2-bccf-4537-be7a-37ce996bbe87 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.147706 Jun 14 19:45:52.338910 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 250/527] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:52 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:53.356734 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-fce91ed0-8dfb-4e9b-9fda-0a8b8b1c6d5a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:53.357281 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-fce91ed0-8dfb-4e9b-9fda-0a8b8b1c6d5a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:53.363734 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fce91ed0-8dfb-4e9b-9fda-0a8b8b1c6d5a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:53.364176 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fce91ed0-8dfb-4e9b-9fda-0a8b8b1c6d5a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:53.364980 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fce91ed0-8dfb-4e9b-9fda-0a8b8b1c6d5a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:53.365435 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fce91ed0-8dfb-4e9b-9fda-0a8b8b1c6d5a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:53.497230 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-fce91ed0-8dfb-4e9b-9fda-0a8b8b1c6d5a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:53.505712 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-fce91ed0-8dfb-4e9b-9fda-0a8b8b1c6d5a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.152864 Jun 14 19:45:53.506271 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 278/528] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:53 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:54.522802 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2ad0be81-45ce-43e2-a208-1009aee579da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:54.523435 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2ad0be81-45ce-43e2-a208-1009aee579da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:54.530260 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2ad0be81-45ce-43e2-a208-1009aee579da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:54.530712 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2ad0be81-45ce-43e2-a208-1009aee579da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:54.531471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2ad0be81-45ce-43e2-a208-1009aee579da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:54.531906 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2ad0be81-45ce-43e2-a208-1009aee579da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:54.667607 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2ad0be81-45ce-43e2-a208-1009aee579da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:54.676087 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2ad0be81-45ce-43e2-a208-1009aee579da tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.157128 Jun 14 19:45:54.676673 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 251/529] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:54 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:55.697253 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b1e4303f-5469-4584-bd80-4124042b88d1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:55.697930 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b1e4303f-5469-4584-bd80-4124042b88d1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:55.705257 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b1e4303f-5469-4584-bd80-4124042b88d1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:55.705742 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b1e4303f-5469-4584-bd80-4124042b88d1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:55.706517 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b1e4303f-5469-4584-bd80-4124042b88d1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:55.706953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b1e4303f-5469-4584-bd80-4124042b88d1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:55.835080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b1e4303f-5469-4584-bd80-4124042b88d1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:55.843023 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b1e4303f-5469-4584-bd80-4124042b88d1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.149631 Jun 14 19:45:55.843582 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 279/530] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:55 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:56.859842 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d8eaf60e-905f-4bd5-bd23-a49aa887e79b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:56.860444 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d8eaf60e-905f-4bd5-bd23-a49aa887e79b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:56.867607 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d8eaf60e-905f-4bd5-bd23-a49aa887e79b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:56.868038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d8eaf60e-905f-4bd5-bd23-a49aa887e79b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:56.868785 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d8eaf60e-905f-4bd5-bd23-a49aa887e79b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:56.869215 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d8eaf60e-905f-4bd5-bd23-a49aa887e79b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:56.996000 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d8eaf60e-905f-4bd5-bd23-a49aa887e79b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:57.004451 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d8eaf60e-905f-4bd5-bd23-a49aa887e79b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.148404 Jun 14 19:45:57.005026 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 252/531] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:56 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:57.945140 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-8870f2da-824c-472a-8862-9ca58a47c947 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:57.945650 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8870f2da-824c-472a-8862-9ca58a47c947 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:57.951969 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8870f2da-824c-472a-8862-9ca58a47c947 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:57.952410 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8870f2da-824c-472a-8862-9ca58a47c947 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:57.953158 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8870f2da-824c-472a-8862-9ca58a47c947 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:57.953707 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8870f2da-824c-472a-8862-9ca58a47c947 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:57.981837 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-8870f2da-824c-472a-8862-9ca58a47c947 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/os-volume_attachments/26de5fd8-5c85-457c-996b-2c1ea3df2e92" status: 200 len: 194 microversion: 2.20 time: 0.040738 Jun 14 19:45:57.982390 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 280/532] 10.222.0.44 () {60 vars in 1453 bytes} [Tue Jun 14 19:45:57 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/os-volume_attachments/26de5fd8-5c85-457c-996b-2c1ea3df2e92 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:45:58.021898 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c0fd984a-9101-4594-944f-dd8347718c80 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:58.022506 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c0fd984a-9101-4594-944f-dd8347718c80 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:58.028906 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0fd984a-9101-4594-944f-dd8347718c80 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:58.029626 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0fd984a-9101-4594-944f-dd8347718c80 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:58.030147 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0fd984a-9101-4594-944f-dd8347718c80 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:58.030581 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0fd984a-9101-4594-944f-dd8347718c80 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:58.044931 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-72f65f36-59b2-455e-a4cf-4a509603e391 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:58.045435 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-72f65f36-59b2-455e-a4cf-4a509603e391 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:58.051597 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72f65f36-59b2-455e-a4cf-4a509603e391 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:58.052042 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72f65f36-59b2-455e-a4cf-4a509603e391 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:58.052791 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72f65f36-59b2-455e-a4cf-4a509603e391 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:58.053237 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72f65f36-59b2-455e-a4cf-4a509603e391 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:58.134181 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.objects.instance [None req-72f65f36-59b2-455e-a4cf-4a509603e391 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lazy-loading 'services' on Instance uuid 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 {{(pid=124068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:45:58.168014 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c0fd984a-9101-4594-944f-dd8347718c80 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:58.176206 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c0fd984a-9101-4594-944f-dd8347718c80 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.158056 Jun 14 19:45:58.176881 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 253/533] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:58 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:45:58.207158 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-72f65f36-59b2-455e-a4cf-4a509603e391 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/os-volume_attachments/26de5fd8-5c85-457c-996b-2c1ea3df2e92" status: 202 len: 0 microversion: 2.20 time: 0.166057 Jun 14 19:45:58.207749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 281/534] 10.222.0.44 () {60 vars in 1456 bytes} [Tue Jun 14 19:45:58 2022] DELETE /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/os-volume_attachments/26de5fd8-5c85-457c-996b-2c1ea3df2e92 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 14 19:45:58.216194 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-bd51a4bb-faac-46a8-a025-c228b1154619 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:58.217114 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-bd51a4bb-faac-46a8-a025-c228b1154619 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:58.223734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bd51a4bb-faac-46a8-a025-c228b1154619 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:58.224189 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bd51a4bb-faac-46a8-a025-c228b1154619 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:58.224945 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bd51a4bb-faac-46a8-a025-c228b1154619 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:58.225395 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bd51a4bb-faac-46a8-a025-c228b1154619 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:58.254639 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-bd51a4bb-faac-46a8-a025-c228b1154619 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042340 Jun 14 19:45:58.255198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 254/535] 10.222.0.44 () {60 vars in 1342 bytes} [Tue Jun 14 19:45:58 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:45:59.195087 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b908f9e1-319b-41af-984d-b98437e14fc1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:59.195816 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b908f9e1-319b-41af-984d-b98437e14fc1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:59.201994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b908f9e1-319b-41af-984d-b98437e14fc1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:59.202445 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b908f9e1-319b-41af-984d-b98437e14fc1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:59.203201 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b908f9e1-319b-41af-984d-b98437e14fc1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:59.203638 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b908f9e1-319b-41af-984d-b98437e14fc1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:59.267173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-693d1137-aff1-493c-baa6-92a6bad2c638 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:59.267927 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-693d1137-aff1-493c-baa6-92a6bad2c638 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:59.274463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-693d1137-aff1-493c-baa6-92a6bad2c638 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:59.274888 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-693d1137-aff1-493c-baa6-92a6bad2c638 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:59.275642 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-693d1137-aff1-493c-baa6-92a6bad2c638 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:59.276066 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-693d1137-aff1-493c-baa6-92a6bad2c638 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:59.305544 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-693d1137-aff1-493c-baa6-92a6bad2c638 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042731 Jun 14 19:45:59.306102 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 255/536] 10.222.0.44 () {60 vars in 1342 bytes} [Tue Jun 14 19:45:59 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:45:59.335373 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b908f9e1-319b-41af-984d-b98437e14fc1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:59.343357 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b908f9e1-319b-41af-984d-b98437e14fc1 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.152961 Jun 14 19:45:59.344016 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 282/537] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:45:59 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:45:59.362888 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-cbe678ce-e2ff-4ead-bc17-13aa131e7e88 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:59.363314 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-cbe678ce-e2ff-4ead-bc17-13aa131e7e88 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:59.369248 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cbe678ce-e2ff-4ead-bc17-13aa131e7e88 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:59.369826 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cbe678ce-e2ff-4ead-bc17-13aa131e7e88 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:59.370568 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cbe678ce-e2ff-4ead-bc17-13aa131e7e88 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:59.370993 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cbe678ce-e2ff-4ead-bc17-13aa131e7e88 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:59.396372 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-cbe678ce-e2ff-4ead-bc17-13aa131e7e88 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Going to try to terminate instance {{(pid=124069) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:45:59.471882 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-cbe678ce-e2ff-4ead-bc17-13aa131e7e88 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 204 len: 0 microversion: 2.20 time: 0.113027 Jun 14 19:45:59.472884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 256/538] 10.222.0.44 () {60 vars in 1279 bytes} [Tue Jun 14 19:45:59 2022] DELETE /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 14 19:45:59.481151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-7e057993-9101-45c7-9854-4e4b5f61c629 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:45:59.481776 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-7e057993-9101-45c7-9854-4e4b5f61c629 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:45:59.488334 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7e057993-9101-45c7-9854-4e4b5f61c629 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:59.488775 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7e057993-9101-45c7-9854-4e4b5f61c629 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:59.489554 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7e057993-9101-45c7-9854-4e4b5f61c629 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:45:59.489978 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7e057993-9101-45c7-9854-4e4b5f61c629 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:45:59.852130 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-7e057993-9101-45c7-9854-4e4b5f61c629 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:59.859933 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-7e057993-9101-45c7-9854-4e4b5f61c629 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:59.862062 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-7e057993-9101-45c7-9854-4e4b5f61c629 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:45:59.863215 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-7e057993-9101-45c7-9854-4e4b5f61c629 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.385946 Jun 14 19:45:59.863804 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 283/539] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:45:59 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:46:00.361025 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-52646b04-1a18-4506-a5eb-d0e83c329f9b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:00.361784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-52646b04-1a18-4506-a5eb-d0e83c329f9b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:00.368181 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-52646b04-1a18-4506-a5eb-d0e83c329f9b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:00.368631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-52646b04-1a18-4506-a5eb-d0e83c329f9b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:00.369400 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-52646b04-1a18-4506-a5eb-d0e83c329f9b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:00.369844 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-52646b04-1a18-4506-a5eb-d0e83c329f9b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:00.497333 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-52646b04-1a18-4506-a5eb-d0e83c329f9b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:00.506163 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-52646b04-1a18-4506-a5eb-d0e83c329f9b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.149416 Jun 14 19:46:00.506735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 257/540] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:00 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:00.881260 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1e2a9471-2dbd-49bb-83dc-ca12cab8ff0f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:00.881936 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1e2a9471-2dbd-49bb-83dc-ca12cab8ff0f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:00.888478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1e2a9471-2dbd-49bb-83dc-ca12cab8ff0f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:00.888921 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1e2a9471-2dbd-49bb-83dc-ca12cab8ff0f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:00.889699 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1e2a9471-2dbd-49bb-83dc-ca12cab8ff0f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:00.890130 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1e2a9471-2dbd-49bb-83dc-ca12cab8ff0f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:01.022585 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1e2a9471-2dbd-49bb-83dc-ca12cab8ff0f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:01.030772 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1e2a9471-2dbd-49bb-83dc-ca12cab8ff0f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:01.032925 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1e2a9471-2dbd-49bb-83dc-ca12cab8ff0f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:01.034273 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1e2a9471-2dbd-49bb-83dc-ca12cab8ff0f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1722 microversion: 2.20 time: 0.156828 Jun 14 19:46:01.034831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 284/541] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:00 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:46:01.523627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9a0b181f-91a5-43f3-b212-889dfc47959d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:01.524347 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9a0b181f-91a5-43f3-b212-889dfc47959d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:01.531092 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a0b181f-91a5-43f3-b212-889dfc47959d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:01.531614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a0b181f-91a5-43f3-b212-889dfc47959d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:01.532711 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a0b181f-91a5-43f3-b212-889dfc47959d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:01.532911 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a0b181f-91a5-43f3-b212-889dfc47959d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:01.781893 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9a0b181f-91a5-43f3-b212-889dfc47959d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:01.789953 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9a0b181f-91a5-43f3-b212-889dfc47959d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.270147 Jun 14 19:46:01.790867 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 258/542] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:01 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:02.054921 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-af707a2e-9513-4a1a-8acc-3976754b3278 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:02.055951 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-af707a2e-9513-4a1a-8acc-3976754b3278 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:02.063051 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-af707a2e-9513-4a1a-8acc-3976754b3278 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:02.064039 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-af707a2e-9513-4a1a-8acc-3976754b3278 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:02.064814 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-af707a2e-9513-4a1a-8acc-3976754b3278 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:02.065281 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-af707a2e-9513-4a1a-8acc-3976754b3278 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:02.131425 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-af707a2e-9513-4a1a-8acc-3976754b3278 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:02.139695 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-af707a2e-9513-4a1a-8acc-3976754b3278 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:02.141195 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-af707a2e-9513-4a1a-8acc-3976754b3278 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:02.143592 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-af707a2e-9513-4a1a-8acc-3976754b3278 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 200 len: 1655 microversion: 2.20 time: 0.094863 Jun 14 19:46:02.144161 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 285/543] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:02 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 1655 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:46:02.455674 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-77dd5364-e836-407c-9bbe-bf2d4c10bb65 req-9825191a-1253-4166-b59a-6db3e726c10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2d9ed3-941a-496c-b3c8-a9a5648cd846", "name": "network-vif-deleted", "tag": "5445a8aa-6257-4a17-8a1b-eff254fa9a9d"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:02.464549 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-77dd5364-e836-407c-9bbe-bf2d4c10bb65 req-9825191a-1253-4166-b59a-6db3e726c10a service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:02.464990 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-77dd5364-e836-407c-9bbe-bf2d4c10bb65 req-9825191a-1253-4166-b59a-6db3e726c10a service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:02.475902 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-77dd5364-e836-407c-9bbe-bf2d4c10bb65 req-9825191a-1253-4166-b59a-6db3e726c10a service nova] Creating event network-vif-deleted:5445a8aa-6257-4a17-8a1b-eff254fa9a9d for instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 on hv-cinder-84580 Jun 14 19:46:02.481287 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-77dd5364-e836-407c-9bbe-bf2d4c10bb65 req-9825191a-1253-4166-b59a-6db3e726c10a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030398 Jun 14 19:46:02.482275 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 259/544] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:46:02.807870 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-5619113a-a327-42a3-89c5-e94bd70cdb68 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:02.808633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-5619113a-a327-42a3-89c5-e94bd70cdb68 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:02.815927 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5619113a-a327-42a3-89c5-e94bd70cdb68 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:02.816622 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5619113a-a327-42a3-89c5-e94bd70cdb68 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:02.817629 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5619113a-a327-42a3-89c5-e94bd70cdb68 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:02.818072 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5619113a-a327-42a3-89c5-e94bd70cdb68 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:02.945969 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-5619113a-a327-42a3-89c5-e94bd70cdb68 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:02.953880 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-5619113a-a327-42a3-89c5-e94bd70cdb68 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.149871 Jun 14 19:46:02.954903 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 286/545] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:02 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:03.163749 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b9ea6aeb-d89a-42a0-a373-375eeaa71145 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:03.164456 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b9ea6aeb-d89a-42a0-a373-375eeaa71145 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:03.170834 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b9ea6aeb-d89a-42a0-a373-375eeaa71145 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:03.171288 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b9ea6aeb-d89a-42a0-a373-375eeaa71145 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:03.172057 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b9ea6aeb-d89a-42a0-a373-375eeaa71145 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:03.173447 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b9ea6aeb-d89a-42a0-a373-375eeaa71145 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:03.188076 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-b9ea6aeb-d89a-42a0-a373-375eeaa71145 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] HTTP exception thrown: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b9ea6aeb-d89a-42a0-a373-375eeaa71145 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Request method failure captured: Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 HTTP/1.1 Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSGSyi__YACn28acM6Q8Pka71yXqU1v4hFXT4AS5dvj4sf2iufYAfzc3rSHEa6Ow771gvgY3ceCNxgLbE9eIdBJWdECrPGV2nniAl-4WAsQqmmGCSx45YB-EN0lKvl-wZ6GoCJfWU4iA5jvlxuapGSCrtzh7F1ghRL35mYwWCG-nXE Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: 070bbe844e8945eca60ecc95244acd53 Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:46:03.189778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:46:03.191399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/070bbe844e8945eca60ecc95244acd53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_070bbe844e8945eca60ecc95244acd53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/070bbe844e8945eca60ecc95244acd53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/070bbe844e8945eca60ecc95244acd53"}]}] Jun 14 19:46:03.191399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:46:03.191399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: 070bbe844e8945eca60ecc95244acd53 Jun 14 19:46:03.191399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:46:03.191399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeShelveTestJSON-1507149085-project Jun 14 19:46:03.191399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:46:03.191399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:46:03.191399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: f60ed90fb1a54339ac563bc649e98989 Jun 14 19:46:03.191399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1507149085-project Jun 14 19:46:03.191399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:46:03.191399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. Jun 14 19:46:03.191399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '1f2d9ed3-941a-496c-b3c8-a9a5648cd846'} Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:46:03.192359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. Jun 14 19:46:03.193976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:46:03.195236 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b9ea6aeb-d89a-42a0-a373-375eeaa71145 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Returning 404 to user: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:46:03.195236 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b9ea6aeb-d89a-42a0-a373-375eeaa71145 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 404 len: 111 microversion: 2.20 time: 0.032338 Jun 14 19:46:03.195536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 260/546] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:03 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 14 19:46:03.200328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-05065e61-96a7-42ce-913a-cea514a9f7c4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '.version_select at 0x7f144adba820>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:03.222330 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-05065e61-96a7-42ce-913a-cea514a9f7c4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547246200" status: 204 len: 0 microversion: 2.20 time: 0.025771 Jun 14 19:46:03.222917 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 287/547] 10.222.0.44 () {60 vars in 1261 bytes} [Tue Jun 14 19:46:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547246200 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 14 19:46:03.972596 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-0a89032b-9f15-4762-b1de-b952d322cb64 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:03.973647 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-0a89032b-9f15-4762-b1de-b952d322cb64 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:03.982418 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0a89032b-9f15-4762-b1de-b952d322cb64 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:03.983072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0a89032b-9f15-4762-b1de-b952d322cb64 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:03.983898 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0a89032b-9f15-4762-b1de-b952d322cb64 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:03.984273 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0a89032b-9f15-4762-b1de-b952d322cb64 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:03.990534 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:04.286671 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-2a04f520-42b2-4a85-b859-b2642742c204 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Action: 'create', calling method: .version_select at 0x7f144ae65310>, body: {"keypair": {"name": "tempest-keypair-1080798083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvdLsQttyt+ptY5zpgaSh5jYnEWc83h4g+fNcqKybraAfNReFnwHcyTXa+HD9buGxtjO7E0xCxoZAchggocJ+ZNKx7RfFRiBrfSv+LI4KxvofEEBcYlkCxmzgRO3GD0PA=="}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:04.301273 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-0a89032b-9f15-4762-b1de-b952d322cb64 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:04.305170 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-2a04f520-42b2-4a85-b859-b2642742c204 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Getting quotas for project 070bbe844e8945eca60ecc95244acd53. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:46:04.309034 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-2a04f520-42b2-4a85-b859-b2642742c204 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Getting quotas for user f60ed90fb1a54339ac563bc649e98989 and project 070bbe844e8945eca60ecc95244acd53. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:46:04.309345 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-0a89032b-9f15-4762-b1de-b952d322cb64 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.341949 Jun 14 19:46:04.310283 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 261/548] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:03 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:04.333147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-2a04f520-42b2-4a85-b859-b2642742c204 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050371 Jun 14 19:46:04.333778 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 288/549] 10.222.0.44 () {62 vars in 1199 bytes} [Tue Jun 14 19:46:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 14 19:46:05.327135 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8e16b6bb-acd2-4fdf-a223-239ab46a28fd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:05.327755 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8e16b6bb-acd2-4fdf-a223-239ab46a28fd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:05.334146 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e16b6bb-acd2-4fdf-a223-239ab46a28fd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:05.334536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e16b6bb-acd2-4fdf-a223-239ab46a28fd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:05.335303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e16b6bb-acd2-4fdf-a223-239ab46a28fd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:05.335740 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e16b6bb-acd2-4fdf-a223-239ab46a28fd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:05.479895 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8e16b6bb-acd2-4fdf-a223-239ab46a28fd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:05.488648 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8e16b6bb-acd2-4fdf-a223-239ab46a28fd tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.165337 Jun 14 19:46:05.489608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 262/550] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:05 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:05.609767 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1790720732", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c8e1214-e4f6-4bbf-87ef-85a053e8689c"}], "security_groups": [{"name": "tempest-securitygroup--1132213226"}], "key_name": "tempest-keypair-1080798083", "user_data": "}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:05.711359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.network.neutron [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] validate_networks() for [('6c8e1214-e4f6-4bbf-87ef-85a053e8689c', None, None, None, None, None)] {{(pid=124068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:46:06.069056 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Flavor limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:46:06.069518 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Image limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:46:06.069999 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Flavor pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:46:06.070443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Image pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:46:06.070857 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:46:06.079541 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:06.080007 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:06.080809 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:06.081248 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:06.098627 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Getting quotas for project 070bbe844e8945eca60ecc95244acd53. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:46:06.102572 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Getting quotas for user f60ed90fb1a54339ac563bc649e98989 and project 070bbe844e8945eca60ecc95244acd53. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:46:06.114071 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Going to run 1 instances... {{(pid=124068) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:46:06.116309 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:46:06.161859 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f1a48570-98c1-4282-9488-ab591906da97 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.556840 Jun 14 19:46:06.162429 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 289/551] 10.222.0.44 () {62 vars in 1187 bytes} [Tue Jun 14 19:46:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 14 19:46:06.173479 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-e8f210fc-4bac-416e-b478-f880084c81e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:06.174119 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-e8f210fc-4bac-416e-b478-f880084c81e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:06.228170 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e8f210fc-4bac-416e-b478-f880084c81e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:06.235646 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e8f210fc-4bac-416e-b478-f880084c81e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:06.237176 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e8f210fc-4bac-416e-b478-f880084c81e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:06.238428 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-e8f210fc-4bac-416e-b478-f880084c81e7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1282 microversion: 2.20 time: 0.069541 Jun 14 19:46:06.238996 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 263/552] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:06 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:46:06.506391 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-919cccc9-e541-4a2e-8cd8-d0bfe8ee1b3f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:06.507095 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-919cccc9-e541-4a2e-8cd8-d0bfe8ee1b3f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:06.513250 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-919cccc9-e541-4a2e-8cd8-d0bfe8ee1b3f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:06.513732 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-919cccc9-e541-4a2e-8cd8-d0bfe8ee1b3f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:06.514491 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-919cccc9-e541-4a2e-8cd8-d0bfe8ee1b3f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:06.514924 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-919cccc9-e541-4a2e-8cd8-d0bfe8ee1b3f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:06.652700 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-919cccc9-e541-4a2e-8cd8-d0bfe8ee1b3f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:06.661929 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-919cccc9-e541-4a2e-8cd8-d0bfe8ee1b3f tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.159452 Jun 14 19:46:06.662707 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 290/553] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:06 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:07.256706 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-fe03fa15-2f5a-430f-8f66-9a22c26c960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:07.258014 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-fe03fa15-2f5a-430f-8f66-9a22c26c960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:07.265426 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fe03fa15-2f5a-430f-8f66-9a22c26c960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:07.265879 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fe03fa15-2f5a-430f-8f66-9a22c26c960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:07.267723 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fe03fa15-2f5a-430f-8f66-9a22c26c960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:07.268215 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fe03fa15-2f5a-430f-8f66-9a22c26c960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:07.335700 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-fe03fa15-2f5a-430f-8f66-9a22c26c960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:07.344129 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-fe03fa15-2f5a-430f-8f66-9a22c26c960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:07.345728 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-fe03fa15-2f5a-430f-8f66-9a22c26c960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:07.346851 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-fe03fa15-2f5a-430f-8f66-9a22c26c960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1352 microversion: 2.20 time: 0.094100 Jun 14 19:46:07.347405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 264/554] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:07 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:46:07.679665 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d37bff14-19cc-4bb5-af39-e2f651d829fe tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:07.680282 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d37bff14-19cc-4bb5-af39-e2f651d829fe tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:07.686547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d37bff14-19cc-4bb5-af39-e2f651d829fe tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:07.687005 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d37bff14-19cc-4bb5-af39-e2f651d829fe tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:07.687772 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d37bff14-19cc-4bb5-af39-e2f651d829fe tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:07.688864 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d37bff14-19cc-4bb5-af39-e2f651d829fe tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:07.819564 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d37bff14-19cc-4bb5-af39-e2f651d829fe tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:07.827945 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d37bff14-19cc-4bb5-af39-e2f651d829fe tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.152209 Jun 14 19:46:07.829049 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 291/555] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:07 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:08.364899 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4801d7d2-e35f-4d3a-84c1-bb258e3556a1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:08.365519 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4801d7d2-e35f-4d3a-84c1-bb258e3556a1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:08.372151 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4801d7d2-e35f-4d3a-84c1-bb258e3556a1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:08.372598 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4801d7d2-e35f-4d3a-84c1-bb258e3556a1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:08.373353 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4801d7d2-e35f-4d3a-84c1-bb258e3556a1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:08.373811 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4801d7d2-e35f-4d3a-84c1-bb258e3556a1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:08.505859 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4801d7d2-e35f-4d3a-84c1-bb258e3556a1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:08.513786 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4801d7d2-e35f-4d3a-84c1-bb258e3556a1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:08.515288 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4801d7d2-e35f-4d3a-84c1-bb258e3556a1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:08.516927 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4801d7d2-e35f-4d3a-84c1-bb258e3556a1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1408 microversion: 2.20 time: 0.156055 Jun 14 19:46:08.517502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 265/556] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:08 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:46:08.846752 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d22df22c-e656-4a16-8f6e-d9651180be73 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:08.847368 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d22df22c-e656-4a16-8f6e-d9651180be73 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:08.853826 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d22df22c-e656-4a16-8f6e-d9651180be73 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:08.854279 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d22df22c-e656-4a16-8f6e-d9651180be73 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:08.855054 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d22df22c-e656-4a16-8f6e-d9651180be73 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:08.855487 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d22df22c-e656-4a16-8f6e-d9651180be73 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:08.999133 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d22df22c-e656-4a16-8f6e-d9651180be73 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:09.009295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d22df22c-e656-4a16-8f6e-d9651180be73 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.166494 Jun 14 19:46:09.020363 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 292/557] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:08 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:09.158217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-d3afdf51-c364-470b-963e-b9bed890aae6 req-552d815e-48cc-416b-be8b-67ea53a67ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574d3163-12b7-4f68-9f90-445a0d1b0b8e", "tag": "367ce7c0-470d-4698-8a1e-52c8e78f7f64"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:09.166278 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-d3afdf51-c364-470b-963e-b9bed890aae6 req-552d815e-48cc-416b-be8b-67ea53a67ec4 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:09.166972 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-d3afdf51-c364-470b-963e-b9bed890aae6 req-552d815e-48cc-416b-be8b-67ea53a67ec4 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:09.179135 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-d3afdf51-c364-470b-963e-b9bed890aae6 req-552d815e-48cc-416b-be8b-67ea53a67ec4 service nova] Creating event network-changed:367ce7c0-470d-4698-8a1e-52c8e78f7f64 for instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e on hv-cinder-84580 Jun 14 19:46:09.183956 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-d3afdf51-c364-470b-963e-b9bed890aae6 req-552d815e-48cc-416b-be8b-67ea53a67ec4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030210 Jun 14 19:46:09.184579 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 266/558] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:46:09.534884 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-93d08c80-e155-4962-863b-8d787d76796a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:09.535766 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-93d08c80-e155-4962-863b-8d787d76796a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:09.542203 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-93d08c80-e155-4962-863b-8d787d76796a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:09.542658 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-93d08c80-e155-4962-863b-8d787d76796a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:09.543432 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-93d08c80-e155-4962-863b-8d787d76796a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:09.543871 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-93d08c80-e155-4962-863b-8d787d76796a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:09.674659 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-93d08c80-e155-4962-863b-8d787d76796a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:09.682606 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-93d08c80-e155-4962-863b-8d787d76796a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:09.684093 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-93d08c80-e155-4962-863b-8d787d76796a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:09.685181 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-93d08c80-e155-4962-863b-8d787d76796a tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1408 microversion: 2.20 time: 0.154727 Jun 14 19:46:09.686021 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 293/559] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:09 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:46:10.033248 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8bc351f7-7698-4cbd-9907-a756fd98daf8 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:10.034529 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8bc351f7-7698-4cbd-9907-a756fd98daf8 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:10.040703 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8bc351f7-7698-4cbd-9907-a756fd98daf8 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:10.041152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8bc351f7-7698-4cbd-9907-a756fd98daf8 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:10.041956 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8bc351f7-7698-4cbd-9907-a756fd98daf8 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:10.042395 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8bc351f7-7698-4cbd-9907-a756fd98daf8 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:10.167604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8bc351f7-7698-4cbd-9907-a756fd98daf8 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:10.176168 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8bc351f7-7698-4cbd-9907-a756fd98daf8 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1732 microversion: 2.1 time: 0.147594 Jun 14 19:46:10.176723 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 267/560] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:10 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:10.702797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-40720bea-f536-4fb5-8825-08e1bdb64682 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:10.703483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-40720bea-f536-4fb5-8825-08e1bdb64682 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:10.710732 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-40720bea-f536-4fb5-8825-08e1bdb64682 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:10.711121 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-40720bea-f536-4fb5-8825-08e1bdb64682 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:10.711900 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-40720bea-f536-4fb5-8825-08e1bdb64682 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:10.712336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-40720bea-f536-4fb5-8825-08e1bdb64682 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:10.727511 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:10.851695 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-40720bea-f536-4fb5-8825-08e1bdb64682 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:10.860098 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-40720bea-f536-4fb5-8825-08e1bdb64682 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:10.861652 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-40720bea-f536-4fb5-8825-08e1bdb64682 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:10.862782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-40720bea-f536-4fb5-8825-08e1bdb64682 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1408 microversion: 2.20 time: 0.163880 Jun 14 19:46:10.863349 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 294/561] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:10 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:46:11.193027 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c26dd934-e7a9-48e6-aa00-3326019f98b0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:11.193651 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c26dd934-e7a9-48e6-aa00-3326019f98b0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:11.200069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c26dd934-e7a9-48e6-aa00-3326019f98b0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:11.200514 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c26dd934-e7a9-48e6-aa00-3326019f98b0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:11.201259 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c26dd934-e7a9-48e6-aa00-3326019f98b0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:11.201717 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c26dd934-e7a9-48e6-aa00-3326019f98b0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:11.329056 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c26dd934-e7a9-48e6-aa00-3326019f98b0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:11.337486 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c26dd934-e7a9-48e6-aa00-3326019f98b0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1712 microversion: 2.1 time: 0.148298 Jun 14 19:46:11.338048 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 268/562] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:11 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1712 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:11.438311 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f9e2aa1a-565f-4945-ae54-a17f45695e6b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:11.438815 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f9e2aa1a-565f-4945-ae54-a17f45695e6b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:11.445367 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f9e2aa1a-565f-4945-ae54-a17f45695e6b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:11.445849 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f9e2aa1a-565f-4945-ae54-a17f45695e6b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:11.446615 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f9e2aa1a-565f-4945-ae54-a17f45695e6b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:11.447058 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f9e2aa1a-565f-4945-ae54-a17f45695e6b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:11.525746 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-f9e2aa1a-565f-4945-ae54-a17f45695e6b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] HTTP exception thrown: Cannot 'detach_volume' instance e845044c-b4e8-462f-abf8-0301476ec285 while it is in vm_state rescued Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f9e2aa1a-565f-4945-ae54-a17f45695e6b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Request method failure captured: Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: DELETE /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/os-volume_attachments/16370e04-a042-4267-8841-f5fe24864181 HTTP/1.1 Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOSXUwwI56eYhwPi9XEqhROraEksfHEb5IhPTbtyoll9ykvqMufFEeOqcOjWlLfF0jHg3hjdxlHtwds_NUimsgWEGN2iosCI_kqST9tecc6ZQuwsF46IreezwH9Tsojmvc-hqied-ovexRJRO7Dbf74R8f-SimKcNP1P1U9zDqlYnTE Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: 05db8610cfa7449daeec7419d4f7ad6c Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1296840289 Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:46:11.527589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:46:11.528984 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05db8610cfa7449daeec7419d4f7ad6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_05db8610cfa7449daeec7419d4f7ad6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/05db8610cfa7449daeec7419d4f7ad6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05db8610cfa7449daeec7419d4f7ad6c"}]}] Jun 14 19:46:11.528984 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1296840289 Jun 14 19:46:11.528984 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: 05db8610cfa7449daeec7419d4f7ad6c Jun 14 19:46:11.528984 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1296840289 Jun 14 19:46:11.528984 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-ServerRescueNegativeTestJSON-1296840289-project Jun 14 19:46:11.528984 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:46:11.528984 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:46:11.528984 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 9b28c3b97f9f44148dd02f41509887e8 Jun 14 19:46:11.528984 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1296840289-project Jun 14 19:46:11.528984 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:46:11.528984 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Cannot 'detach_volume' instance e845044c-b4e8-462f-abf8-0301476ec285 while it is in vm_state rescued Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'server_id': 'e845044c-b4e8-462f-abf8-0301476ec285', 'id': '16370e04-a042-4267-8841-f5fe24864181'} Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e845044c-b4e8-462f-abf8-0301476ec285 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:46:11.529741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e845044c-b4e8-462f-abf8-0301476ec285 while it is in vm_state rescued Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e845044c-b4e8-462f-abf8-0301476ec285 while it is in vm_state rescued Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:46:11.530963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f9e2aa1a-565f-4945-ae54-a17f45695e6b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Returning 409 to user: Cannot 'detach_volume' instance e845044c-b4e8-462f-abf8-0301476ec285 while it is in vm_state rescued {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:46:11.532087 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f9e2aa1a-565f-4945-ae54-a17f45695e6b tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/os-volume_attachments/16370e04-a042-4267-8841-f5fe24864181" status: 409 len: 152 microversion: 2.1 time: 0.094631 Jun 14 19:46:11.532087 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 295/563] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 14 19:46:11 2022] DELETE /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/os-volume_attachments/16370e04-a042-4267-8841-f5fe24864181 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 14 19:46:11.537962 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-abcfbd9c-546c-49d2-b9ca-7de3f7e4bf22 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:11.538494 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-abcfbd9c-546c-49d2-b9ca-7de3f7e4bf22 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:11.544400 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-abcfbd9c-546c-49d2-b9ca-7de3f7e4bf22 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:11.544847 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-abcfbd9c-546c-49d2-b9ca-7de3f7e4bf22 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:11.545628 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-abcfbd9c-546c-49d2-b9ca-7de3f7e4bf22 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:11.546062 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-abcfbd9c-546c-49d2-b9ca-7de3f7e4bf22 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:11.608961 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-abcfbd9c-546c-49d2-b9ca-7de3f7e4bf22 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "POST /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/action" status: 202 len: 0 microversion: 2.1 time: 0.074792 Jun 14 19:46:11.609625 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 269/564] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 14 19:46:11 2022] POST /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:46:11.617879 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9711ab24-acd4-41a0-b413-e381a7ef8f88 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:11.618500 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9711ab24-acd4-41a0-b413-e381a7ef8f88 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:11.625289 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9711ab24-acd4-41a0-b413-e381a7ef8f88 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:11.625764 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9711ab24-acd4-41a0-b413-e381a7ef8f88 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:11.626523 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9711ab24-acd4-41a0-b413-e381a7ef8f88 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:11.626960 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9711ab24-acd4-41a0-b413-e381a7ef8f88 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:11.756689 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9711ab24-acd4-41a0-b413-e381a7ef8f88 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:11.764474 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9711ab24-acd4-41a0-b413-e381a7ef8f88 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1720 microversion: 2.1 time: 0.150505 Jun 14 19:46:11.765027 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 296/565] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:11 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:11.881536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-471bd488-ef0d-42fc-8f08-cac60e8af0f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:11.882236 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-471bd488-ef0d-42fc-8f08-cac60e8af0f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:11.888400 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-471bd488-ef0d-42fc-8f08-cac60e8af0f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:11.888845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-471bd488-ef0d-42fc-8f08-cac60e8af0f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:11.889624 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-471bd488-ef0d-42fc-8f08-cac60e8af0f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:11.890057 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-471bd488-ef0d-42fc-8f08-cac60e8af0f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:12.023730 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-471bd488-ef0d-42fc-8f08-cac60e8af0f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:12.032161 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-471bd488-ef0d-42fc-8f08-cac60e8af0f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:12.033704 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-471bd488-ef0d-42fc-8f08-cac60e8af0f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:12.035684 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-471bd488-ef0d-42fc-8f08-cac60e8af0f0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1408 microversion: 2.20 time: 0.158473 Jun 14 19:46:12.036242 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 270/566] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:11 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:46:12.782626 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-5eeb350b-deca-4b42-a513-a28f69368639 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:12.783235 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-5eeb350b-deca-4b42-a513-a28f69368639 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:12.790270 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5eeb350b-deca-4b42-a513-a28f69368639 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:12.790722 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5eeb350b-deca-4b42-a513-a28f69368639 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:12.791477 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5eeb350b-deca-4b42-a513-a28f69368639 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:12.791912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5eeb350b-deca-4b42-a513-a28f69368639 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:12.921953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-5eeb350b-deca-4b42-a513-a28f69368639 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:12.930867 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-5eeb350b-deca-4b42-a513-a28f69368639 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1720 microversion: 2.1 time: 0.152147 Jun 14 19:46:12.931417 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 297/567] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:12 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:13.054441 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a984e9f4-ce09-4b2d-ab77-112111238868 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:13.055000 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a984e9f4-ce09-4b2d-ab77-112111238868 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:13.061639 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a984e9f4-ce09-4b2d-ab77-112111238868 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:13.062099 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a984e9f4-ce09-4b2d-ab77-112111238868 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:13.062834 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a984e9f4-ce09-4b2d-ab77-112111238868 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:13.063260 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a984e9f4-ce09-4b2d-ab77-112111238868 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:13.195660 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a984e9f4-ce09-4b2d-ab77-112111238868 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:13.203412 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a984e9f4-ce09-4b2d-ab77-112111238868 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:13.204905 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a984e9f4-ce09-4b2d-ab77-112111238868 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:13.206115 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a984e9f4-ce09-4b2d-ab77-112111238868 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1408 microversion: 2.20 time: 0.156392 Jun 14 19:46:13.206656 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 271/568] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:13 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:46:13.947299 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-72edf76a-bd00-4c4f-8dcc-0fef37173525 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:13.947982 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-72edf76a-bd00-4c4f-8dcc-0fef37173525 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:13.954333 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72edf76a-bd00-4c4f-8dcc-0fef37173525 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:13.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72edf76a-bd00-4c4f-8dcc-0fef37173525 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:13.955615 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72edf76a-bd00-4c4f-8dcc-0fef37173525 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:13.956710 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72edf76a-bd00-4c4f-8dcc-0fef37173525 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:14.085157 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-72edf76a-bd00-4c4f-8dcc-0fef37173525 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:14.093255 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-72edf76a-bd00-4c4f-8dcc-0fef37173525 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1720 microversion: 2.1 time: 0.149788 Jun 14 19:46:14.093867 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 298/569] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:13 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:14.224273 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-96d7e54d-a5c5-47c0-b851-bf17e4a144ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:14.224872 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-96d7e54d-a5c5-47c0-b851-bf17e4a144ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:14.231348 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96d7e54d-a5c5-47c0-b851-bf17e4a144ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:14.231781 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96d7e54d-a5c5-47c0-b851-bf17e4a144ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:14.232520 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96d7e54d-a5c5-47c0-b851-bf17e4a144ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:14.232943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96d7e54d-a5c5-47c0-b851-bf17e4a144ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:14.364370 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-96d7e54d-a5c5-47c0-b851-bf17e4a144ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:14.372287 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-96d7e54d-a5c5-47c0-b851-bf17e4a144ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:14.373815 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-96d7e54d-a5c5-47c0-b851-bf17e4a144ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:14.374922 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-96d7e54d-a5c5-47c0-b851-bf17e4a144ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1408 microversion: 2.20 time: 0.154924 Jun 14 19:46:14.375467 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 272/570] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:14 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:46:15.110139 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-7dd56c5d-2632-47a6-866e-4bc5129aab9c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:15.110700 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-7dd56c5d-2632-47a6-866e-4bc5129aab9c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:15.117212 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7dd56c5d-2632-47a6-866e-4bc5129aab9c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:15.117701 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7dd56c5d-2632-47a6-866e-4bc5129aab9c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:15.118463 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7dd56c5d-2632-47a6-866e-4bc5129aab9c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:15.118898 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7dd56c5d-2632-47a6-866e-4bc5129aab9c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:15.245611 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-7dd56c5d-2632-47a6-866e-4bc5129aab9c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:15.254158 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-7dd56c5d-2632-47a6-866e-4bc5129aab9c tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1726 microversion: 2.1 time: 0.147878 Jun 14 19:46:15.254773 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 299/571] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:15 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:15.271329 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-7e43e210-a8f2-4954-b741-e0edbfcf9ddc tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:15.271853 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-7e43e210-a8f2-4954-b741-e0edbfcf9ddc tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:15.278518 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7e43e210-a8f2-4954-b741-e0edbfcf9ddc tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:15.278957 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7e43e210-a8f2-4954-b741-e0edbfcf9ddc tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:15.279711 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7e43e210-a8f2-4954-b741-e0edbfcf9ddc tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:15.280139 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7e43e210-a8f2-4954-b741-e0edbfcf9ddc tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:15.360354 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-7e43e210-a8f2-4954-b741-e0edbfcf9ddc tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093610 Jun 14 19:46:15.360888 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 273/572] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 14 19:46:15 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:46:15.394029 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e6b68415-9b41-4c88-9727-57a9912b3475 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:15.394828 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e6b68415-9b41-4c88-9727-57a9912b3475 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:15.396657 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:15.402531 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e6b68415-9b41-4c88-9727-57a9912b3475 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:15.402982 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e6b68415-9b41-4c88-9727-57a9912b3475 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:15.403751 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e6b68415-9b41-4c88-9727-57a9912b3475 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:15.404285 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e6b68415-9b41-4c88-9727-57a9912b3475 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:15.539742 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-e6b68415-9b41-4c88-9727-57a9912b3475 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:15.547627 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-e6b68415-9b41-4c88-9727-57a9912b3475 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:15.549120 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-e6b68415-9b41-4c88-9727-57a9912b3475 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:15.550843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e6b68415-9b41-4c88-9727-57a9912b3475 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1408 microversion: 2.20 time: 0.161270 Jun 14 19:46:15.551384 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 300/573] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:15 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:46:16.228434 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-da408725-4a83-4efc-a7ce-7639a9fc22f4 req-4148e063-6f8b-4d86-a6f4-46c44faef195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e845044c-b4e8-462f-abf8-0301476ec285", "tag": "dcc13ad8-c81f-4feb-9c9c-0a5b20e3af4e"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:16.232264 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:16.239553 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-da408725-4a83-4efc-a7ce-7639a9fc22f4 req-4148e063-6f8b-4d86-a6f4-46c44faef195 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:16.240550 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-da408725-4a83-4efc-a7ce-7639a9fc22f4 req-4148e063-6f8b-4d86-a6f4-46c44faef195 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:16.252258 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-da408725-4a83-4efc-a7ce-7639a9fc22f4 req-4148e063-6f8b-4d86-a6f4-46c44faef195 service nova] Creating event network-changed:dcc13ad8-c81f-4feb-9c9c-0a5b20e3af4e for instance e845044c-b4e8-462f-abf8-0301476ec285 on hv-cinder-84580 Jun 14 19:46:16.257318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-da408725-4a83-4efc-a7ce-7639a9fc22f4 req-4148e063-6f8b-4d86-a6f4-46c44faef195 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033085 Jun 14 19:46:16.257953 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 274/574] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:46:16.479139 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-17606cd7-3d19-4ccf-a247-9437b7786086 req-8b694b53-ca4a-4072-8ebb-e2c5abed9571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574d3163-12b7-4f68-9f90-445a0d1b0b8e", "name": "network-vif-plugged", "status": "completed", "tag": "367ce7c0-470d-4698-8a1e-52c8e78f7f64"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:16.490682 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:16.491834 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=10 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:16.496715 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-17606cd7-3d19-4ccf-a247-9437b7786086 req-8b694b53-ca4a-4072-8ebb-e2c5abed9571 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:16.497777 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-17606cd7-3d19-4ccf-a247-9437b7786086 req-8b694b53-ca4a-4072-8ebb-e2c5abed9571 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:16.513263 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-17606cd7-3d19-4ccf-a247-9437b7786086 req-8b694b53-ca4a-4072-8ebb-e2c5abed9571 service nova] Creating event network-vif-plugged:367ce7c0-470d-4698-8a1e-52c8e78f7f64 for instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e on hv-cinder-84580 Jun 14 19:46:16.519520 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-17606cd7-3d19-4ccf-a247-9437b7786086 req-8b694b53-ca4a-4072-8ebb-e2c5abed9571 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044213 Jun 14 19:46:16.520459 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 301/575] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:46:16.570569 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b236ba26-cdb7-44b9-952c-ee4573bc6be3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:16.571102 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b236ba26-cdb7-44b9-952c-ee4573bc6be3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:16.583284 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b236ba26-cdb7-44b9-952c-ee4573bc6be3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:16.584500 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b236ba26-cdb7-44b9-952c-ee4573bc6be3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:16.585934 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b236ba26-cdb7-44b9-952c-ee4573bc6be3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:16.586378 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b236ba26-cdb7-44b9-952c-ee4573bc6be3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:16.796888 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-b236ba26-cdb7-44b9-952c-ee4573bc6be3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:16.805036 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-b236ba26-cdb7-44b9-952c-ee4573bc6be3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:16.806587 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-b236ba26-cdb7-44b9-952c-ee4573bc6be3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:16.807679 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b236ba26-cdb7-44b9-952c-ee4573bc6be3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1408 microversion: 2.20 time: 0.243190 Jun 14 19:46:16.808445 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 275/576] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:16 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:46:17.826655 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-930d5716-53a8-4d1f-af76-50949f022e40 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:17.827372 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-930d5716-53a8-4d1f-af76-50949f022e40 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:17.834680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-930d5716-53a8-4d1f-af76-50949f022e40 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:17.835125 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-930d5716-53a8-4d1f-af76-50949f022e40 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:17.835883 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-930d5716-53a8-4d1f-af76-50949f022e40 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:17.836315 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-930d5716-53a8-4d1f-af76-50949f022e40 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:17.973319 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-930d5716-53a8-4d1f-af76-50949f022e40 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:17.981396 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-930d5716-53a8-4d1f-af76-50949f022e40 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:17.982947 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-930d5716-53a8-4d1f-af76-50949f022e40 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:17.984079 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-930d5716-53a8-4d1f-af76-50949f022e40 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1408 microversion: 2.20 time: 0.161684 Jun 14 19:46:17.984646 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 302/577] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:17 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:46:18.272447 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-628fc7a2-7231-4c69-8f7b-578e4e7708ef req-8aa1573c-e371-4d63-96a8-5bd737470da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e845044c-b4e8-462f-abf8-0301476ec285", "tag": "dcc13ad8-c81f-4feb-9c9c-0a5b20e3af4e"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:18.281338 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-628fc7a2-7231-4c69-8f7b-578e4e7708ef req-8aa1573c-e371-4d63-96a8-5bd737470da5 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:18.281800 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-628fc7a2-7231-4c69-8f7b-578e4e7708ef req-8aa1573c-e371-4d63-96a8-5bd737470da5 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:18.292703 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-628fc7a2-7231-4c69-8f7b-578e4e7708ef req-8aa1573c-e371-4d63-96a8-5bd737470da5 service nova] Creating event network-changed:dcc13ad8-c81f-4feb-9c9c-0a5b20e3af4e for instance e845044c-b4e8-462f-abf8-0301476ec285 on hv-cinder-84580 Jun 14 19:46:18.297303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-628fc7a2-7231-4c69-8f7b-578e4e7708ef req-8aa1573c-e371-4d63-96a8-5bd737470da5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029537 Jun 14 19:46:18.297892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 276/578] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:46:19.003250 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d8efc9b7-4725-4bae-9b38-8bde64fa0878 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:19.004352 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d8efc9b7-4725-4bae-9b38-8bde64fa0878 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:19.011034 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d8efc9b7-4725-4bae-9b38-8bde64fa0878 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:19.011487 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d8efc9b7-4725-4bae-9b38-8bde64fa0878 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:19.012259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d8efc9b7-4725-4bae-9b38-8bde64fa0878 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:19.012698 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d8efc9b7-4725-4bae-9b38-8bde64fa0878 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:19.144276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d8efc9b7-4725-4bae-9b38-8bde64fa0878 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:19.152271 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d8efc9b7-4725-4bae-9b38-8bde64fa0878 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:19.153778 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d8efc9b7-4725-4bae-9b38-8bde64fa0878 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:19.154913 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d8efc9b7-4725-4bae-9b38-8bde64fa0878 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1601 microversion: 2.20 time: 0.156464 Jun 14 19:46:19.155463 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 303/579] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:18 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:46:19.172433 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-535fc205-aa89-42b2-8bce-0cf338453182 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:19.173010 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-535fc205-aa89-42b2-8bce-0cf338453182 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:19.179370 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-535fc205-aa89-42b2-8bce-0cf338453182 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:19.179848 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-535fc205-aa89-42b2-8bce-0cf338453182 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:19.180599 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-535fc205-aa89-42b2-8bce-0cf338453182 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:19.181029 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-535fc205-aa89-42b2-8bce-0cf338453182 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:19.258232 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-535fc205-aa89-42b2-8bce-0cf338453182 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089937 Jun 14 19:46:19.258833 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 277/580] 10.222.0.44 () {60 vars in 1315 bytes} [Tue Jun 14 19:46:19 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:46:20.311652 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-e237121e-7b52-4011-910e-241fb6393fd9 req-fd783ed9-b017-42d1-97a1-1d0bc8b892c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574d3163-12b7-4f68-9f90-445a0d1b0b8e", "tag": "367ce7c0-470d-4698-8a1e-52c8e78f7f64"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:20.320937 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-e237121e-7b52-4011-910e-241fb6393fd9 req-fd783ed9-b017-42d1-97a1-1d0bc8b892c4 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:20.321403 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-e237121e-7b52-4011-910e-241fb6393fd9 req-fd783ed9-b017-42d1-97a1-1d0bc8b892c4 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:20.332685 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-e237121e-7b52-4011-910e-241fb6393fd9 req-fd783ed9-b017-42d1-97a1-1d0bc8b892c4 service nova] Creating event network-changed:367ce7c0-470d-4698-8a1e-52c8e78f7f64 for instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e on hv-cinder-84580 Jun 14 19:46:20.337489 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-e237121e-7b52-4011-910e-241fb6393fd9 req-fd783ed9-b017-42d1-97a1-1d0bc8b892c4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029476 Jun 14 19:46:20.338085 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 304/581] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:46:28.089989 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ef3f4ecf-4903-4e68-8907-6947f651824e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:28.090522 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ef3f4ecf-4903-4e68-8907-6947f651824e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:28.092329 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:28.098808 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ef3f4ecf-4903-4e68-8907-6947f651824e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:28.099247 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ef3f4ecf-4903-4e68-8907-6947f651824e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:28.100007 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ef3f4ecf-4903-4e68-8907-6947f651824e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:28.100429 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ef3f4ecf-4903-4e68-8907-6947f651824e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:28.124604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-ef3f4ecf-4903-4e68-8907-6947f651824e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a/ips" status: 200 len: 148 microversion: 2.1 time: 0.039237 Jun 14 19:46:28.125166 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 278/582] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 14 19:46:28 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:46:29.432345 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-aba93c0c-d792-4d45-b07a-546ab648f840 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bbf7051-8304-478e-956f-7833625632ac"}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:29.433496 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-aba93c0c-d792-4d45-b07a-546ab648f840 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:29.440134 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aba93c0c-d792-4d45-b07a-546ab648f840 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:29.440583 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aba93c0c-d792-4d45-b07a-546ab648f840 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:29.441336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aba93c0c-d792-4d45-b07a-546ab648f840 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:29.441806 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aba93c0c-d792-4d45-b07a-546ab648f840 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:29.674809 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-aba93c0c-d792-4d45-b07a-546ab648f840 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "POST /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247219 Jun 14 19:46:29.675508 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 305/583] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 14 19:46:29 2022] POST /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:46:37.161161 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-5ea19471-20e4-451b-b690-7f36e85ac201 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bbf7051-8304-478e-956f-7833625632ac"}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:37.162252 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-5ea19471-20e4-451b-b690-7f36e85ac201 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:37.168381 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5ea19471-20e4-451b-b690-7f36e85ac201 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:37.168819 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5ea19471-20e4-451b-b690-7f36e85ac201 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:37.169600 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5ea19471-20e4-451b-b690-7f36e85ac201 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:37.170030 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5ea19471-20e4-451b-b690-7f36e85ac201 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:37.172319 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:37.248885 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-5ea19471-20e4-451b-b690-7f36e85ac201 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] HTTP exception thrown: Invalid volume: volume 3bbf7051-8304-478e-956f-7833625632ac is already attached to instances: c5bae0a1-ab48-4943-95c1-bf124010357a Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-5ea19471-20e4-451b-b690-7f36e85ac201 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Request method failure captured: Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: POST /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a/os-volume_attachments HTTP/1.1 Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 74 Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSSLZpR2w_xFmfjar75tGJDU2sD62hg-I9tSk--QtfqjFSlliGkRH_W6CYwZ7Iph2aF4fxrjxzyeJzd_hl0QyZ4Pw-2UckaxY5_2H0QoR9Blg4BQM7Y5TpsnBrEMi60m5uD-Uzx7H-VX8XJXxLhIjXrvmJpguoa2gF4eYzoPZCLZyc Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:46:37.250633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:46:37.252185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}] Jun 14 19:46:37.252185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:46:37.252185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:46:37.252185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:46:37.252185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:46:37.252185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:46:37.252185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:46:37.252185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 323c51f037db4ecca2f66cb6e9879246 Jun 14 19:46:37.252185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:46:37.252185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Jun 14 19:46:37.252185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {"volumeAttachment": {"volumeId": "3bbf7051-8304-478e-956f-7833625632ac"}} Jun 14 19:46:37.252185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Invalid volume: volume 3bbf7051-8304-478e-956f-7833625632ac is already attached to instances: c5bae0a1-ab48-4943-95c1-bf124010357a Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'server_id': 'c5bae0a1-ab48-4943-95c1-bf124010357a', 'body': {'volumeAttachment': {'volumeId': '3bbf7051-8304-478e-956f-7833625632ac'}}} Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3bbf7051-8304-478e-956f-7833625632ac is already attached to instances: c5bae0a1-ab48-4943-95c1-bf124010357a Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:46:37.253072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3bbf7051-8304-478e-956f-7833625632ac is already attached to instances: c5bae0a1-ab48-4943-95c1-bf124010357a Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:46:37.255122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:46:37.256285 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:46:37.256285 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:46:37.256285 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:46:37.256285 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3bbf7051-8304-478e-956f-7833625632ac is already attached to instances: c5bae0a1-ab48-4943-95c1-bf124010357a Jun 14 19:46:37.256285 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:46:37.256285 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-5ea19471-20e4-451b-b690-7f36e85ac201 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Returning 400 to user: Invalid volume: volume 3bbf7051-8304-478e-956f-7833625632ac is already attached to instances: c5bae0a1-ab48-4943-95c1-bf124010357a {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:46:37.256285 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-5ea19471-20e4-451b-b690-7f36e85ac201 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "POST /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094893 Jun 14 19:46:37.256285 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 279/584] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 14 19:46:37 2022] POST /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 14 19:46:37.313742 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-58985512-fd81-4801-898e-e0b418a6161c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:37.314270 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-58985512-fd81-4801-898e-e0b418a6161c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:37.320938 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-58985512-fd81-4801-898e-e0b418a6161c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:37.321421 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-58985512-fd81-4801-898e-e0b418a6161c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:37.322260 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-58985512-fd81-4801-898e-e0b418a6161c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:37.322698 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-58985512-fd81-4801-898e-e0b418a6161c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:37.401362 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.objects.instance [None req-58985512-fd81-4801-898e-e0b418a6161c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lazy-loading 'services' on Instance uuid c5bae0a1-ab48-4943-95c1-bf124010357a {{(pid=124068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:46:37.473952 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-58985512-fd81-4801-898e-e0b418a6161c tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a/os-volume_attachments/3bbf7051-8304-478e-956f-7833625632ac" status: 202 len: 0 microversion: 2.1 time: 0.164824 Jun 14 19:46:37.474537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 306/585] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 14 19:46:37 2022] DELETE /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a/os-volume_attachments/3bbf7051-8304-478e-956f-7833625632ac => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:46:37.483182 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-29b0dc86-a167-4054-9db8-b0a69b61f693 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:37.484498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-29b0dc86-a167-4054-9db8-b0a69b61f693 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:37.491739 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-29b0dc86-a167-4054-9db8-b0a69b61f693 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:37.492261 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-29b0dc86-a167-4054-9db8-b0a69b61f693 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:37.493084 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-29b0dc86-a167-4054-9db8-b0a69b61f693 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:37.493651 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-29b0dc86-a167-4054-9db8-b0a69b61f693 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:37.526842 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-29b0dc86-a167-4054-9db8-b0a69b61f693 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047915 Jun 14 19:46:37.527393 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 280/586] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:46:37 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:46:38.539925 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d043edca-8d16-4aa2-821c-13a4a90dafd6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:38.540885 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d043edca-8d16-4aa2-821c-13a4a90dafd6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:38.547080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d043edca-8d16-4aa2-821c-13a4a90dafd6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:38.547523 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d043edca-8d16-4aa2-821c-13a4a90dafd6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:38.548264 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d043edca-8d16-4aa2-821c-13a4a90dafd6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:38.548718 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d043edca-8d16-4aa2-821c-13a4a90dafd6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:38.577220 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d043edca-8d16-4aa2-821c-13a4a90dafd6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042600 Jun 14 19:46:38.577789 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 307/587] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:46:38 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 19:46:38.634185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-7332162a-45c1-4c58-99e8-d8853f497a1a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:38.634786 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-7332162a-45c1-4c58-99e8-d8853f497a1a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:38.641251 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7332162a-45c1-4c58-99e8-d8853f497a1a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:38.641724 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7332162a-45c1-4c58-99e8-d8853f497a1a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:38.642476 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7332162a-45c1-4c58-99e8-d8853f497a1a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:38.642905 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7332162a-45c1-4c58-99e8-d8853f497a1a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:38.669130 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-7332162a-45c1-4c58-99e8-d8853f497a1a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Going to try to terminate instance {{(pid=124069) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:46:38.744862 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-7332162a-45c1-4c58-99e8-d8853f497a1a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 204 len: 0 microversion: 2.1 time: 0.114148 Jun 14 19:46:38.745845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 281/588] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:46:38 2022] DELETE /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 14 19:46:38.755003 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-acd9361e-7bde-49fb-8f3b-e760fa983946 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:38.755649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-acd9361e-7bde-49fb-8f3b-e760fa983946 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:38.761619 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-acd9361e-7bde-49fb-8f3b-e760fa983946 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:38.762068 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-acd9361e-7bde-49fb-8f3b-e760fa983946 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:38.762911 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-acd9361e-7bde-49fb-8f3b-e760fa983946 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:38.763347 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-acd9361e-7bde-49fb-8f3b-e760fa983946 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:38.902488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-acd9361e-7bde-49fb-8f3b-e760fa983946 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:38.904785 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a1027f89-a307-40b5-a6b6-b9058d73f045 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:38.905854 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a1027f89-a307-40b5-a6b6-b9058d73f045 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:38.910784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-acd9361e-7bde-49fb-8f3b-e760fa983946 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1681 microversion: 2.1 time: 0.160239 Jun 14 19:46:38.911634 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 308/589] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:38 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:38.912966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a1027f89-a307-40b5-a6b6-b9058d73f045 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:38.913432 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a1027f89-a307-40b5-a6b6-b9058d73f045 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:38.914198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a1027f89-a307-40b5-a6b6-b9058d73f045 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:38.914628 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a1027f89-a307-40b5-a6b6-b9058d73f045 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:38.942334 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a1027f89-a307-40b5-a6b6-b9058d73f045 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042093 Jun 14 19:46:38.942876 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 282/590] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:46:38 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 14 19:46:38.998406 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-6c99b3f1-3741-4e4a-a060-68c97d15a773 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:38.998900 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-6c99b3f1-3741-4e4a-a060-68c97d15a773 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:39.004994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6c99b3f1-3741-4e4a-a060-68c97d15a773 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:39.005478 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6c99b3f1-3741-4e4a-a060-68c97d15a773 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:39.006232 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6c99b3f1-3741-4e4a-a060-68c97d15a773 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:39.006661 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6c99b3f1-3741-4e4a-a060-68c97d15a773 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:39.037432 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-6c99b3f1-3741-4e4a-a060-68c97d15a773 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Going to try to terminate instance {{(pid=124068) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:46:39.062710 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:39.111792 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-6c99b3f1-3741-4e4a-a060-68c97d15a773 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 204 len: 0 microversion: 2.1 time: 0.116794 Jun 14 19:46:39.112295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 309/591] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:46:38 2022] DELETE /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:46:39.120600 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2080df37-3582-4a30-a873-1cec397b3aa7 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:39.121211 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2080df37-3582-4a30-a873-1cec397b3aa7 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:39.127165 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2080df37-3582-4a30-a873-1cec397b3aa7 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:39.127638 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2080df37-3582-4a30-a873-1cec397b3aa7 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:39.128385 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2080df37-3582-4a30-a873-1cec397b3aa7 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:39.128814 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2080df37-3582-4a30-a873-1cec397b3aa7 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:39.256841 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2080df37-3582-4a30-a873-1cec397b3aa7 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:39.264281 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2080df37-3582-4a30-a873-1cec397b3aa7 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1673 microversion: 2.1 time: 0.147525 Jun 14 19:46:39.264842 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 283/592] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:39 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:39.928881 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d43edb40-d3e7-4146-93e1-5059ed87ce44 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:39.929603 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d43edb40-d3e7-4146-93e1-5059ed87ce44 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:39.935675 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d43edb40-d3e7-4146-93e1-5059ed87ce44 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:39.936119 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d43edb40-d3e7-4146-93e1-5059ed87ce44 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:39.936866 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d43edb40-d3e7-4146-93e1-5059ed87ce44 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:39.937292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d43edb40-d3e7-4146-93e1-5059ed87ce44 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:40.083034 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d43edb40-d3e7-4146-93e1-5059ed87ce44 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:40.090557 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d43edb40-d3e7-4146-93e1-5059ed87ce44 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1681 microversion: 2.1 time: 0.166363 Jun 14 19:46:40.091205 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 310/593] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:39 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:40.282056 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-781cae52-74dc-41dd-8d5a-910be3c1fb09 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:40.282664 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-781cae52-74dc-41dd-8d5a-910be3c1fb09 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:40.291422 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-781cae52-74dc-41dd-8d5a-910be3c1fb09 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:40.291867 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-781cae52-74dc-41dd-8d5a-910be3c1fb09 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:40.292623 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-781cae52-74dc-41dd-8d5a-910be3c1fb09 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:40.293050 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-781cae52-74dc-41dd-8d5a-910be3c1fb09 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:40.438688 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-781cae52-74dc-41dd-8d5a-910be3c1fb09 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:40.446652 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-781cae52-74dc-41dd-8d5a-910be3c1fb09 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1673 microversion: 2.1 time: 0.168387 Jun 14 19:46:40.447757 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 284/594] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:40 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:41.107346 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-acd873b3-1f51-42d2-b15b-25ca75d4872f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:41.107885 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-acd873b3-1f51-42d2-b15b-25ca75d4872f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:41.114363 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-acd873b3-1f51-42d2-b15b-25ca75d4872f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:41.114968 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-acd873b3-1f51-42d2-b15b-25ca75d4872f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:41.115733 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-acd873b3-1f51-42d2-b15b-25ca75d4872f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:41.116167 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-acd873b3-1f51-42d2-b15b-25ca75d4872f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:41.242882 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-acd873b3-1f51-42d2-b15b-25ca75d4872f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:41.250324 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-acd873b3-1f51-42d2-b15b-25ca75d4872f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1681 microversion: 2.1 time: 0.146898 Jun 14 19:46:41.250886 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 311/595] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:41 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:41.464843 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-62a76f62-189e-45b1-b9b5-5b36e4fed54c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:41.465422 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-62a76f62-189e-45b1-b9b5-5b36e4fed54c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:41.471775 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-62a76f62-189e-45b1-b9b5-5b36e4fed54c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:41.472215 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-62a76f62-189e-45b1-b9b5-5b36e4fed54c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:41.472981 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-62a76f62-189e-45b1-b9b5-5b36e4fed54c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:41.473408 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-62a76f62-189e-45b1-b9b5-5b36e4fed54c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:41.599059 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-62a76f62-189e-45b1-b9b5-5b36e4fed54c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:41.606400 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-62a76f62-189e-45b1-b9b5-5b36e4fed54c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1673 microversion: 2.1 time: 0.145453 Jun 14 19:46:41.606959 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 285/596] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:41 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:42.267559 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-486b763f-18d5-4be4-8131-23820a76b0f8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:42.268169 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-486b763f-18d5-4be4-8131-23820a76b0f8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:42.275834 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-486b763f-18d5-4be4-8131-23820a76b0f8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:42.276285 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-486b763f-18d5-4be4-8131-23820a76b0f8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:42.277047 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-486b763f-18d5-4be4-8131-23820a76b0f8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:42.277505 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-486b763f-18d5-4be4-8131-23820a76b0f8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:42.475450 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-486b763f-18d5-4be4-8131-23820a76b0f8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:42.482658 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-486b763f-18d5-4be4-8131-23820a76b0f8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1681 microversion: 2.1 time: 0.218894 Jun 14 19:46:42.483457 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 312/597] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:42 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:42.623990 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b18a2991-cbd7-4101-b8d9-7bba9a4354ea tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:42.624885 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b18a2991-cbd7-4101-b8d9-7bba9a4354ea tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:42.631794 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b18a2991-cbd7-4101-b8d9-7bba9a4354ea tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:42.632332 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b18a2991-cbd7-4101-b8d9-7bba9a4354ea tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:42.633198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b18a2991-cbd7-4101-b8d9-7bba9a4354ea tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:42.633727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b18a2991-cbd7-4101-b8d9-7bba9a4354ea tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:42.866660 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-b18a2991-cbd7-4101-b8d9-7bba9a4354ea tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:42.874274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b18a2991-cbd7-4101-b8d9-7bba9a4354ea tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1673 microversion: 2.1 time: 0.254107 Jun 14 19:46:42.875056 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 286/598] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:42 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1673 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:43.253152 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-b69efdb1-742f-41de-a468-f8279f6ccb65 req-458cfd8f-2e1c-4d8c-844e-aeb8c753047a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5bae0a1-ab48-4943-95c1-bf124010357a", "name": "network-vif-deleted", "tag": "2ec77f05-bca9-42c5-b5cb-ac9e70a0f2f6"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:43.267669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-b69efdb1-742f-41de-a468-f8279f6ccb65 req-458cfd8f-2e1c-4d8c-844e-aeb8c753047a service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:43.270050 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-b69efdb1-742f-41de-a468-f8279f6ccb65 req-458cfd8f-2e1c-4d8c-844e-aeb8c753047a service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:43.320943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-ca4dfe10-a4fd-4f65-b30f-158525810a5a req-a061b8f7-1d12-4c91-abbf-5d3f641dad93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "519d4f97-34a0-4df8-85fe-98149ad589a8", "name": "network-vif-deleted", "tag": "b72f1385-2205-4302-9798-d34c009e5cc2"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:43.326444 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-b69efdb1-742f-41de-a468-f8279f6ccb65 req-458cfd8f-2e1c-4d8c-844e-aeb8c753047a service nova] Creating event network-vif-deleted:2ec77f05-bca9-42c5-b5cb-ac9e70a0f2f6 for instance c5bae0a1-ab48-4943-95c1-bf124010357a on hv-cinder-84580 Jun 14 19:46:43.338997 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-b69efdb1-742f-41de-a468-f8279f6ccb65 req-458cfd8f-2e1c-4d8c-844e-aeb8c753047a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089075 Jun 14 19:46:43.340145 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 313/599] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:46:43.351711 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-ca4dfe10-a4fd-4f65-b30f-158525810a5a req-a061b8f7-1d12-4c91-abbf-5d3f641dad93 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:43.352341 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-ca4dfe10-a4fd-4f65-b30f-158525810a5a req-a061b8f7-1d12-4c91-abbf-5d3f641dad93 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:43.371500 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-ca4dfe10-a4fd-4f65-b30f-158525810a5a req-a061b8f7-1d12-4c91-abbf-5d3f641dad93 service nova] Creating event network-vif-deleted:b72f1385-2205-4302-9798-d34c009e5cc2 for instance 519d4f97-34a0-4df8-85fe-98149ad589a8 on hv-cinder-84580 Jun 14 19:46:43.380393 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-ca4dfe10-a4fd-4f65-b30f-158525810a5a req-a061b8f7-1d12-4c91-abbf-5d3f641dad93 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065805 Jun 14 19:46:43.396624 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 287/600] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:46:43.501222 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9bf4bfcb-b371-4dc4-942b-e78eab79f1cf tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:43.501960 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9bf4bfcb-b371-4dc4-942b-e78eab79f1cf tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:43.513250 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9bf4bfcb-b371-4dc4-942b-e78eab79f1cf tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:43.513731 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9bf4bfcb-b371-4dc4-942b-e78eab79f1cf tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:43.514522 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9bf4bfcb-b371-4dc4-942b-e78eab79f1cf tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:43.516532 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9bf4bfcb-b371-4dc4-942b-e78eab79f1cf tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:43.561844 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9bf4bfcb-b371-4dc4-942b-e78eab79f1cf tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:43.562230 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9bf4bfcb-b371-4dc4-942b-e78eab79f1cf tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:43.562694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.objects.instance [None req-9bf4bfcb-b371-4dc4-942b-e78eab79f1cf tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lazy-loading 'fault' on Instance uuid c5bae0a1-ab48-4943-95c1-bf124010357a {{(pid=124068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:46:43.618879 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9bf4bfcb-b371-4dc4-942b-e78eab79f1cf tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:43.629541 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9bf4bfcb-b371-4dc4-942b-e78eab79f1cf tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 200 len: 1332 microversion: 2.1 time: 0.132718 Jun 14 19:46:43.630741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 314/601] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:43 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 1332 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:43.893164 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-19825e3b-c2df-46f8-8af0-a93640f49ab2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:43.893893 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-19825e3b-c2df-46f8-8af0-a93640f49ab2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:43.901159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-19825e3b-c2df-46f8-8af0-a93640f49ab2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:43.901654 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-19825e3b-c2df-46f8-8af0-a93640f49ab2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:43.902409 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-19825e3b-c2df-46f8-8af0-a93640f49ab2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:43.903009 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-19825e3b-c2df-46f8-8af0-a93640f49ab2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:43.949753 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-19825e3b-c2df-46f8-8af0-a93640f49ab2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:43.950205 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-19825e3b-c2df-46f8-8af0-a93640f49ab2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:43.950654 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.objects.instance [None req-19825e3b-c2df-46f8-8af0-a93640f49ab2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lazy-loading 'fault' on Instance uuid 519d4f97-34a0-4df8-85fe-98149ad589a8 {{(pid=124069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:46:44.003540 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-19825e3b-c2df-46f8-8af0-a93640f49ab2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:44.012554 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-19825e3b-c2df-46f8-8af0-a93640f49ab2 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 200 len: 1327 microversion: 2.1 time: 0.124223 Jun 14 19:46:44.013328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 288/602] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:43 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 1327 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:44.647986 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f4b5aef2-4dd3-4a2f-9ed3-825eb3544638 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:44.648509 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f4b5aef2-4dd3-4a2f-9ed3-825eb3544638 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:44.655284 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f4b5aef2-4dd3-4a2f-9ed3-825eb3544638 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:44.655766 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f4b5aef2-4dd3-4a2f-9ed3-825eb3544638 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:44.656528 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f4b5aef2-4dd3-4a2f-9ed3-825eb3544638 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:44.656967 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f4b5aef2-4dd3-4a2f-9ed3-825eb3544638 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:44.670577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-f4b5aef2-4dd3-4a2f-9ed3-825eb3544638 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] HTTP exception thrown: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f4b5aef2-4dd3-4a2f-9ed3-825eb3544638 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Request method failure captured: Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a HTTP/1.1 Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOSSLZpR2w_xFmfjar75tGJDU2sD62hg-I9tSk--QtfqjFSlliGkRH_W6CYwZ7Iph2aF4fxrjxzyeJzd_hl0QyZ4Pw-2UckaxY5_2H0QoR9Blg4BQM7Y5TpsnBrEMi60m5uD-Uzx7H-VX8XJXxLhIjXrvmJpguoa2gF4eYzoPZCLZyc Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:46:44.672199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:46:44.673680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}] Jun 14 19:46:44.673680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:46:44.673680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:46:44.673680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:46:44.673680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:46:44.673680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:46:44.673680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:46:44.673680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 323c51f037db4ecca2f66cb6e9879246 Jun 14 19:46:44.673680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:46:44.673680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:46:44.673680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. Jun 14 19:46:44.673680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': 'c5bae0a1-ab48-4943-95c1-bf124010357a'} Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:46:44.674547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. Jun 14 19:46:44.675994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:46:44.677331 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f4b5aef2-4dd3-4a2f-9ed3-825eb3544638 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Returning 404 to user: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:46:44.677331 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f4b5aef2-4dd3-4a2f-9ed3-825eb3544638 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 404 len: 111 microversion: 2.1 time: 0.030311 Jun 14 19:46:44.677331 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 315/603] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:44 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:46:44.682554 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b9c04074-dbcd-481a-85e9-3e049556f5d2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '.version_select at 0x7f144b517b80>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:44.700759 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b9c04074-dbcd-481a-85e9-3e049556f5d2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890003777" status: 202 len: 0 microversion: 2.1 time: 0.021961 Jun 14 19:46:44.701311 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 289/604] 10.222.0.44 () {58 vars in 1220 bytes} [Tue Jun 14 19:46:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890003777 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:46:45.031039 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-afa5c6e8-3601-4cd3-811e-d113d2e93589 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:45.031646 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-afa5c6e8-3601-4cd3-811e-d113d2e93589 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:45.037898 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-afa5c6e8-3601-4cd3-811e-d113d2e93589 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:45.038339 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-afa5c6e8-3601-4cd3-811e-d113d2e93589 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:45.039099 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-afa5c6e8-3601-4cd3-811e-d113d2e93589 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:45.039529 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-afa5c6e8-3601-4cd3-811e-d113d2e93589 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:45.053058 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-afa5c6e8-3601-4cd3-811e-d113d2e93589 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] HTTP exception thrown: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-afa5c6e8-3601-4cd3-811e-d113d2e93589 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Request method failure captured: Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 HTTP/1.1 Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOSU6jdf10-DjmYngwGNTGvxjJRWPyC6wno2zEwQBLtN3rsIaP6a83KjWJ2eEIEENFajV9OR0kxR8PY7ebZx2v8ZG5Gr_0T-BD99J6FCbhRE3UFARQrnTpmRPHub0_6quHGwF_vPrL5Q91pvvvRBb_-WMhzCg_dG8m52-AbYYa2CXEM Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: f4aa8aab8447434b8619c3b7bb0b585a Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:46:45.054589 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:46:45.056092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4aa8aab8447434b8619c3b7bb0b585a"}]}] Jun 14 19:46:45.056092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:46:45.056092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: f4aa8aab8447434b8619c3b7bb0b585a Jun 14 19:46:45.056092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:46:45.056092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-AttachVolumeTestJSON-60739376-project Jun 14 19:46:45.056092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:46:45.056092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:46:45.056092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 18261f10678a4ce99626794c39bb5d7f Jun 14 19:46:45.056092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-AttachVolumeTestJSON-60739376-project Jun 14 19:46:45.056092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:46:45.056092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. Jun 14 19:46:45.056092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': '519d4f97-34a0-4df8-85fe-98149ad589a8'} Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:46:45.057006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. Jun 14 19:46:45.058430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:46:45.059658 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-afa5c6e8-3601-4cd3-811e-d113d2e93589 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Returning 404 to user: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:46:45.059658 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-afa5c6e8-3601-4cd3-811e-d113d2e93589 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 404 len: 111 microversion: 2.1 time: 0.028795 Jun 14 19:46:45.059658 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 316/605] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:45 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:46:45.064889 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-58e0bff3-91b1-4735-9cef-8a59596cc1eb tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '.version_select at 0x7f144b4f5ee0>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:45.083167 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-58e0bff3-91b1-4735-9cef-8a59596cc1eb tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088427712" status: 202 len: 0 microversion: 2.1 time: 0.021912 Jun 14 19:46:45.083746 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 290/606] 10.222.0.44 () {58 vars in 1220 bytes} [Tue Jun 14 19:46:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088427712 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:46:45.327991 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e102f621-a182-435d-8729-11c039ee4f6e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Action: 'create', calling method: .version_select at 0x7f144ad94c10>, body: {"keypair": {"name": "tempest-keypair-448417111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/ifZxYZPzkLE9IH0P5R8oL0aSUGVFVFWDuZJGsM/+VegzTI2JAgV4wvwYXaALgt1hKNZOPa+9GezrH59R6fPD5jq9Rk22GPHhZOx8EA17S0Fs8R5d8Wyvczxhxic+gKA=="}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:45.341800 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-e102f621-a182-435d-8729-11c039ee4f6e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:46:45.345602 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-e102f621-a182-435d-8729-11c039ee4f6e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for user 323c51f037db4ecca2f66cb6e9879246 and project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:46:45.368563 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e102f621-a182-435d-8729-11c039ee4f6e tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044381 Jun 14 19:46:45.369158 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 317/607] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 14 19:46:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:46:45.779588 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c6c53fce-d0cf-46a0-9985-67662cd69bfe tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Action: 'create', calling method: .version_select at 0x7f144b6a3160>, body: {"keypair": {"name": "tempest-keypair-246172722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzBMdlceq8iokaaj6/OtQCi+xwXtiRvqzR/Vp/KVzrdXtOrh8cUyE4bjcZeDC0YNBbRJ26ZRjatkco0lLh6KeNkcMeYA+9W4+L9Y4U1RfNENvnDjk3eIozgAAkFhfVfhA=="}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:45.793464 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-c6c53fce-d0cf-46a0-9985-67662cd69bfe tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Getting quotas for project f4aa8aab8447434b8619c3b7bb0b585a. Resources: {'key_pairs'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:46:45.797916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-c6c53fce-d0cf-46a0-9985-67662cd69bfe tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Getting quotas for user 18261f10678a4ce99626794c39bb5d7f and project f4aa8aab8447434b8619c3b7bb0b585a. Resources: {'key_pairs'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:46:45.825475 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c6c53fce-d0cf-46a0-9985-67662cd69bfe tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050254 Jun 14 19:46:45.831008 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 291/608] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 14 19:46:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:46:46.869026 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1326516788", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "810afb1c-546b-4676-b2eb-077f19735ed6"}], "security_groups": [{"name": "tempest-securitygroup--2008845612"}], "key_name": "tempest-keypair-448417111", "user_data": "}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:46.876305 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:46.978251 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.network.neutron [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] validate_networks() for [('810afb1c-546b-4676-b2eb-077f19735ed6', None, None, None, None, None)] {{(pid=124068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:46:47.135017 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1201115085", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0ba18e4-39c5-4788-b560-bb81504c2d7c"}], "security_groups": [{"name": "tempest-securitygroup--199741393"}], "key_name": "tempest-keypair-246172722", "user_data": "}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:47.235211 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.network.neutron [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] validate_networks() for [('d0ba18e4-39c5-4788-b560-bb81504c2d7c', None, None, None, None, None)] {{(pid=124069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:46:47.351284 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Flavor limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:46:47.351732 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Image limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:46:47.352205 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Flavor pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:46:47.352621 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Image pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:46:47.353035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:46:47.361901 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:47.362349 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:47.363148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:47.363804 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:47.381601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:46:47.385654 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Getting quotas for user 323c51f037db4ecca2f66cb6e9879246 and project b2b0a8b4f1e44e2da0750dd3f12fbb18. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:46:47.396463 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Going to run 1 instances... {{(pid=124068) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:46:47.398765 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:46:47.446916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9fecf9a4-271c-470c-8652-cb29bca8c101 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.582622 Jun 14 19:46:47.447561 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 318/609] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:46:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:46:47.457451 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4121af72-3bde-4ccc-80d3-7dbe050ecac4 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:47.458100 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4121af72-3bde-4ccc-80d3-7dbe050ecac4 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:47.518041 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4121af72-3bde-4ccc-80d3-7dbe050ecac4 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:47.525689 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4121af72-3bde-4ccc-80d3-7dbe050ecac4 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1241 microversion: 2.1 time: 0.071970 Jun 14 19:46:47.526508 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 319/610] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:47 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:46:47.618754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Flavor limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:46:47.619183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Image limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:46:47.619710 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Flavor pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:46:47.620124 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Image pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:46:47.620539 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:46:47.629908 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:47.630170 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:47.630976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:47.631412 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:47.648496 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Getting quotas for project f4aa8aab8447434b8619c3b7bb0b585a. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:46:47.653252 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Getting quotas for user 18261f10678a4ce99626794c39bb5d7f and project f4aa8aab8447434b8619c3b7bb0b585a. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:46:47.666021 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Going to run 1 instances... {{(pid=124069) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:46:47.670157 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:46:47.718045 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-eec906e4-2aad-45b2-9528-6c23b402405a tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.587934 Jun 14 19:46:47.718906 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 292/611] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:46:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 14 19:46:47.729681 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-af9a55e3-2b9a-46a3-a99c-241796ae98e3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:47.730488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-af9a55e3-2b9a-46a3-a99c-241796ae98e3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:47.792295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-af9a55e3-2b9a-46a3-a99c-241796ae98e3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:47.806535 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-af9a55e3-2b9a-46a3-a99c-241796ae98e3 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1237 microversion: 2.1 time: 0.080895 Jun 14 19:46:47.807115 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 320/612] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:47 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:48.541883 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-3759ae5c-015f-4f45-9d4a-c28702a80f25 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:48.543205 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-3759ae5c-015f-4f45-9d4a-c28702a80f25 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:48.550688 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3759ae5c-015f-4f45-9d4a-c28702a80f25 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:48.551180 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3759ae5c-015f-4f45-9d4a-c28702a80f25 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:48.552983 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3759ae5c-015f-4f45-9d4a-c28702a80f25 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:48.553734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3759ae5c-015f-4f45-9d4a-c28702a80f25 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:48.620203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-3759ae5c-015f-4f45-9d4a-c28702a80f25 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:48.627671 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-3759ae5c-015f-4f45-9d4a-c28702a80f25 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1299 microversion: 2.1 time: 0.089711 Jun 14 19:46:48.628268 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 293/613] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:48 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:48.824797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e142ee8a-fb46-4081-8a6d-388969544c89 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:48.825428 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e142ee8a-fb46-4081-8a6d-388969544c89 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:48.832553 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e142ee8a-fb46-4081-8a6d-388969544c89 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:48.833037 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e142ee8a-fb46-4081-8a6d-388969544c89 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:48.833896 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e142ee8a-fb46-4081-8a6d-388969544c89 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:48.834513 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e142ee8a-fb46-4081-8a6d-388969544c89 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:48.935582 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-e142ee8a-fb46-4081-8a6d-388969544c89 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:48.945154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e142ee8a-fb46-4081-8a6d-388969544c89 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1289 microversion: 2.1 time: 0.124450 Jun 14 19:46:48.946472 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 321/614] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:48 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1289 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:49.650055 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-0f68ebc7-7f39-4fbc-8bb4-e58fbdc2a5a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:49.655042 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-0f68ebc7-7f39-4fbc-8bb4-e58fbdc2a5a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:49.664617 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0f68ebc7-7f39-4fbc-8bb4-e58fbdc2a5a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:49.665358 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0f68ebc7-7f39-4fbc-8bb4-e58fbdc2a5a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:49.666337 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0f68ebc7-7f39-4fbc-8bb4-e58fbdc2a5a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:49.667095 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0f68ebc7-7f39-4fbc-8bb4-e58fbdc2a5a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:49.864660 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-0f68ebc7-7f39-4fbc-8bb4-e58fbdc2a5a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:49.872665 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-0f68ebc7-7f39-4fbc-8bb4-e58fbdc2a5a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1367 microversion: 2.1 time: 0.231317 Jun 14 19:46:49.873811 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 294/615] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:49 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:49.972369 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1867fb2e-8112-482a-b703-d188338ae1be tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:49.973071 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1867fb2e-8112-482a-b703-d188338ae1be tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:49.981741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1867fb2e-8112-482a-b703-d188338ae1be tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:49.982193 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1867fb2e-8112-482a-b703-d188338ae1be tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:49.982974 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1867fb2e-8112-482a-b703-d188338ae1be tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:49.983406 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1867fb2e-8112-482a-b703-d188338ae1be tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:50.212272 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-e01035f8-e73b-4915-9a86-363a61e4cf61 req-9b13063f-4b85-4756-b0b5-fa2158dabce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "906a717b-f3cc-4340-b6b6-7c47ef2ac058", "tag": "53b179df-e11d-45d1-a96c-7a7732926650"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:50.228732 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-e01035f8-e73b-4915-9a86-363a61e4cf61 req-9b13063f-4b85-4756-b0b5-fa2158dabce7 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:50.229604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-e01035f8-e73b-4915-9a86-363a61e4cf61 req-9b13063f-4b85-4756-b0b5-fa2158dabce7 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:50.258066 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-e01035f8-e73b-4915-9a86-363a61e4cf61 req-9b13063f-4b85-4756-b0b5-fa2158dabce7 service nova] Creating event network-changed:53b179df-e11d-45d1-a96c-7a7732926650 for instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 on hv-cinder-84580 Jun 14 19:46:50.266654 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-e01035f8-e73b-4915-9a86-363a61e4cf61 req-9b13063f-4b85-4756-b0b5-fa2158dabce7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060551 Jun 14 19:46:50.267934 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 295/616] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:46:50.472325 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1867fb2e-8112-482a-b703-d188338ae1be tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:50.481967 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1867fb2e-8112-482a-b703-d188338ae1be tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1362 microversion: 2.1 time: 0.521133 Jun 14 19:46:50.482781 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 322/617] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:49 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1362 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:50.600934 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-0b284a7a-7d6d-44d3-bf5d-52ce81eac3df req-d1f3b6a2-271e-4285-8ef7-322a57fad0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55328760-5eb8-4c2b-bed1-b75b972100a7", "tag": "89baf037-10a7-4dc8-9634-4882cccec5be"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:50.612684 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-0b284a7a-7d6d-44d3-bf5d-52ce81eac3df req-d1f3b6a2-271e-4285-8ef7-322a57fad0c6 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:50.613412 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-0b284a7a-7d6d-44d3-bf5d-52ce81eac3df req-d1f3b6a2-271e-4285-8ef7-322a57fad0c6 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:50.627420 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-0b284a7a-7d6d-44d3-bf5d-52ce81eac3df req-d1f3b6a2-271e-4285-8ef7-322a57fad0c6 service nova] Creating event network-changed:89baf037-10a7-4dc8-9634-4882cccec5be for instance 55328760-5eb8-4c2b-bed1-b75b972100a7 on hv-cinder-84580 Jun 14 19:46:50.633015 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-0b284a7a-7d6d-44d3-bf5d-52ce81eac3df req-d1f3b6a2-271e-4285-8ef7-322a57fad0c6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036942 Jun 14 19:46:50.634019 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 296/618] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:46:50.889889 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a6316e48-0857-443e-90f2-b7a17c77b4a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:50.890490 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a6316e48-0857-443e-90f2-b7a17c77b4a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:50.898042 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a6316e48-0857-443e-90f2-b7a17c77b4a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:50.898492 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a6316e48-0857-443e-90f2-b7a17c77b4a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:50.899263 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a6316e48-0857-443e-90f2-b7a17c77b4a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:50.899972 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a6316e48-0857-443e-90f2-b7a17c77b4a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:51.030299 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a6316e48-0857-443e-90f2-b7a17c77b4a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:51.038367 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a6316e48-0857-443e-90f2-b7a17c77b4a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1367 microversion: 2.1 time: 0.152300 Jun 14 19:46:51.038961 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 323/619] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:50 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:51.499467 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1fc85b95-6d99-400a-8328-635a39cf2ca4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:51.500165 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-1fc85b95-6d99-400a-8328-635a39cf2ca4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:51.507046 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1fc85b95-6d99-400a-8328-635a39cf2ca4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:51.507496 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1fc85b95-6d99-400a-8328-635a39cf2ca4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:51.508258 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1fc85b95-6d99-400a-8328-635a39cf2ca4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:51.508698 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1fc85b95-6d99-400a-8328-635a39cf2ca4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:51.691631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-1fc85b95-6d99-400a-8328-635a39cf2ca4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:51.699480 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-1fc85b95-6d99-400a-8328-635a39cf2ca4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1362 microversion: 2.1 time: 0.204580 Jun 14 19:46:51.700045 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 297/620] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:51 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:52.055326 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a2399643-4caf-4469-8667-b7d315cb2e23 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:52.055878 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a2399643-4caf-4469-8667-b7d315cb2e23 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:52.062264 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2399643-4caf-4469-8667-b7d315cb2e23 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:52.062711 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2399643-4caf-4469-8667-b7d315cb2e23 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:52.063469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2399643-4caf-4469-8667-b7d315cb2e23 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:52.063900 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2399643-4caf-4469-8667-b7d315cb2e23 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:52.193043 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a2399643-4caf-4469-8667-b7d315cb2e23 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:52.200377 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a2399643-4caf-4469-8667-b7d315cb2e23 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1367 microversion: 2.1 time: 0.149152 Jun 14 19:46:52.200943 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 324/621] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:52 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:52.717878 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2a393979-7612-4f68-9d96-ae0a4072ff40 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:52.718696 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2a393979-7612-4f68-9d96-ae0a4072ff40 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:52.726357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2a393979-7612-4f68-9d96-ae0a4072ff40 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:52.726805 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2a393979-7612-4f68-9d96-ae0a4072ff40 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:52.727572 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2a393979-7612-4f68-9d96-ae0a4072ff40 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:52.728005 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2a393979-7612-4f68-9d96-ae0a4072ff40 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:53.120162 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2a393979-7612-4f68-9d96-ae0a4072ff40 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:53.128342 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2a393979-7612-4f68-9d96-ae0a4072ff40 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1362 microversion: 2.1 time: 0.414754 Jun 14 19:46:53.129181 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 298/622] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:52 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1362 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:53.218200 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4765130d-3df9-48d9-b1a1-7fdd60f2c884 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:53.218864 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4765130d-3df9-48d9-b1a1-7fdd60f2c884 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:53.225635 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4765130d-3df9-48d9-b1a1-7fdd60f2c884 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:53.226094 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4765130d-3df9-48d9-b1a1-7fdd60f2c884 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:53.226869 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4765130d-3df9-48d9-b1a1-7fdd60f2c884 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:53.227311 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4765130d-3df9-48d9-b1a1-7fdd60f2c884 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:53.356620 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4765130d-3df9-48d9-b1a1-7fdd60f2c884 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:53.364769 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4765130d-3df9-48d9-b1a1-7fdd60f2c884 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1367 microversion: 2.1 time: 0.149901 Jun 14 19:46:53.365459 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 325/623] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:53 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:54.147369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-07eb8bf0-834c-4570-90a5-922a069ec5e4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:54.147896 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-07eb8bf0-834c-4570-90a5-922a069ec5e4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:54.154720 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-07eb8bf0-834c-4570-90a5-922a069ec5e4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:54.155168 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-07eb8bf0-834c-4570-90a5-922a069ec5e4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:54.155928 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-07eb8bf0-834c-4570-90a5-922a069ec5e4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:54.156361 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-07eb8bf0-834c-4570-90a5-922a069ec5e4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:54.170969 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:54.239043 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b3b15028-4cef-40d8-81a2-e95b915a3f5d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:54.239543 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b3b15028-4cef-40d8-81a2-e95b915a3f5d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:54.246135 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b3b15028-4cef-40d8-81a2-e95b915a3f5d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:54.246684 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b3b15028-4cef-40d8-81a2-e95b915a3f5d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:54.247455 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b3b15028-4cef-40d8-81a2-e95b915a3f5d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:54.247886 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b3b15028-4cef-40d8-81a2-e95b915a3f5d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:54.290736 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-07eb8bf0-834c-4570-90a5-922a069ec5e4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:54.298247 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-07eb8bf0-834c-4570-90a5-922a069ec5e4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1362 microversion: 2.1 time: 0.155482 Jun 14 19:46:54.299033 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 299/624] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:54 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:54.328296 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.objects.instance [None req-b3b15028-4cef-40d8-81a2-e95b915a3f5d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lazy-loading 'services' on Instance uuid e845044c-b4e8-462f-abf8-0301476ec285 {{(pid=124068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:46:54.382095 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-28a995a1-11ce-4aba-be84-b650c08ee6f1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:54.382781 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-28a995a1-11ce-4aba-be84-b650c08ee6f1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:54.388851 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-28a995a1-11ce-4aba-be84-b650c08ee6f1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:54.389302 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-28a995a1-11ce-4aba-be84-b650c08ee6f1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:54.390114 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-28a995a1-11ce-4aba-be84-b650c08ee6f1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:54.390552 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-28a995a1-11ce-4aba-be84-b650c08ee6f1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:54.399120 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b3b15028-4cef-40d8-81a2-e95b915a3f5d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/os-volume_attachments/16370e04-a042-4267-8841-f5fe24864181" status: 202 len: 0 microversion: 2.1 time: 0.163727 Jun 14 19:46:54.400349 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 326/625] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 14 19:46:54 2022] DELETE /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/os-volume_attachments/16370e04-a042-4267-8841-f5fe24864181 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:46:54.409473 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b171d932-8cd7-46ab-bfbd-2a77976f061e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:54.410565 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b171d932-8cd7-46ab-bfbd-2a77976f061e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:54.418274 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b171d932-8cd7-46ab-bfbd-2a77976f061e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:54.418847 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b171d932-8cd7-46ab-bfbd-2a77976f061e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:54.419816 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b171d932-8cd7-46ab-bfbd-2a77976f061e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:54.420905 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b171d932-8cd7-46ab-bfbd-2a77976f061e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:54.456928 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b171d932-8cd7-46ab-bfbd-2a77976f061e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051778 Jun 14 19:46:54.457647 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 327/626] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:46:54 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:46:54.532582 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-28a995a1-11ce-4aba-be84-b650c08ee6f1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:54.540820 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-28a995a1-11ce-4aba-be84-b650c08ee6f1 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1367 microversion: 2.1 time: 0.163110 Jun 14 19:46:54.542012 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 300/627] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:54 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:46:54.858700 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-8ad9c68a-0364-4997-b0c1-9cd53d7e1e2f req-fbda53d4-c941-46d7-a842-d90ee44b043b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906a717b-f3cc-4340-b6b6-7c47ef2ac058", "name": "network-vif-plugged", "status": "completed", "tag": "53b179df-e11d-45d1-a96c-7a7732926650"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:54.867627 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-8ad9c68a-0364-4997-b0c1-9cd53d7e1e2f req-fbda53d4-c941-46d7-a842-d90ee44b043b service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:54.868211 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-8ad9c68a-0364-4997-b0c1-9cd53d7e1e2f req-fbda53d4-c941-46d7-a842-d90ee44b043b service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:54.885146 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-8ad9c68a-0364-4997-b0c1-9cd53d7e1e2f req-fbda53d4-c941-46d7-a842-d90ee44b043b service nova] Creating event network-vif-plugged:53b179df-e11d-45d1-a96c-7a7732926650 for instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 on hv-cinder-84580 Jun 14 19:46:54.890167 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-8ad9c68a-0364-4997-b0c1-9cd53d7e1e2f req-fbda53d4-c941-46d7-a842-d90ee44b043b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035938 Jun 14 19:46:54.890764 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 328/628] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:46:55.314991 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d8c2a885-b0f3-4f2c-b778-85329fdb4b6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:55.315603 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d8c2a885-b0f3-4f2c-b778-85329fdb4b6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:55.322873 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d8c2a885-b0f3-4f2c-b778-85329fdb4b6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:55.323319 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d8c2a885-b0f3-4f2c-b778-85329fdb4b6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:55.324084 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d8c2a885-b0f3-4f2c-b778-85329fdb4b6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:55.324516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d8c2a885-b0f3-4f2c-b778-85329fdb4b6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:55.458385 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d8c2a885-b0f3-4f2c-b778-85329fdb4b6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:55.465904 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d8c2a885-b0f3-4f2c-b778-85329fdb4b6b tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1362 microversion: 2.1 time: 0.154708 Jun 14 19:46:55.466469 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 301/629] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:55 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:55.469711 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-621de6e2-8344-450a-a6a5-f20224836eda tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:55.470708 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-621de6e2-8344-450a-a6a5-f20224836eda tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:55.477208 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-621de6e2-8344-450a-a6a5-f20224836eda tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:55.477689 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-621de6e2-8344-450a-a6a5-f20224836eda tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:55.478446 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-621de6e2-8344-450a-a6a5-f20224836eda tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:55.478880 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-621de6e2-8344-450a-a6a5-f20224836eda tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:55.507235 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-621de6e2-8344-450a-a6a5-f20224836eda tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042351 Jun 14 19:46:55.507791 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 329/630] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:46:55 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 14 19:46:55.558747 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-e2f0de60-9c65-4909-8e4f-44b6c6539969 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:55.559507 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-e2f0de60-9c65-4909-8e4f-44b6c6539969 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:55.567391 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e2f0de60-9c65-4909-8e4f-44b6c6539969 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:55.567943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e2f0de60-9c65-4909-8e4f-44b6c6539969 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:55.569838 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e2f0de60-9c65-4909-8e4f-44b6c6539969 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:55.570295 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e2f0de60-9c65-4909-8e4f-44b6c6539969 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:55.578553 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f33a8aa6-5b8e-48b9-80b3-00a811077152 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:55.579051 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f33a8aa6-5b8e-48b9-80b3-00a811077152 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:55.584906 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f33a8aa6-5b8e-48b9-80b3-00a811077152 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:55.585355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f33a8aa6-5b8e-48b9-80b3-00a811077152 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:55.586143 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f33a8aa6-5b8e-48b9-80b3-00a811077152 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:55.586579 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f33a8aa6-5b8e-48b9-80b3-00a811077152 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:55.611378 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f33a8aa6-5b8e-48b9-80b3-00a811077152 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Going to try to terminate instance {{(pid=124068) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:46:55.614296 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:55.694548 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f33a8aa6-5b8e-48b9-80b3-00a811077152 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 204 len: 0 microversion: 2.1 time: 0.119464 Jun 14 19:46:55.695281 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 330/631] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:46:55 2022] DELETE /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 14 19:46:55.703497 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-7a540f17-fef2-4a8e-8706-be27b012db41 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:55.704196 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-7a540f17-fef2-4a8e-8706-be27b012db41 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:55.710915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7a540f17-fef2-4a8e-8706-be27b012db41 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:55.711366 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7a540f17-fef2-4a8e-8706-be27b012db41 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:55.712131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7a540f17-fef2-4a8e-8706-be27b012db41 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:55.712560 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7a540f17-fef2-4a8e-8706-be27b012db41 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:55.714913 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e2f0de60-9c65-4909-8e4f-44b6c6539969 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:55.722979 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-e2f0de60-9c65-4909-8e4f-44b6c6539969 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1367 microversion: 2.1 time: 0.168120 Jun 14 19:46:55.723558 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 302/632] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:55 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:46:55.843972 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-7a540f17-fef2-4a8e-8706-be27b012db41 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:55.851999 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-7a540f17-fef2-4a8e-8706-be27b012db41 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1686 microversion: 2.1 time: 0.152482 Jun 14 19:46:55.852551 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 331/633] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:55 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:46:56.336859 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c28f54ca-0462-4b3b-9f2e-214d09f322c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:56.337357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c28f54ca-0462-4b3b-9f2e-214d09f322c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:56.343814 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c28f54ca-0462-4b3b-9f2e-214d09f322c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:56.344256 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c28f54ca-0462-4b3b-9f2e-214d09f322c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:56.345008 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c28f54ca-0462-4b3b-9f2e-214d09f322c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:56.345470 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c28f54ca-0462-4b3b-9f2e-214d09f322c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:56.369143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c28f54ca-0462-4b3b-9f2e-214d09f322c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e/ips" status: 200 len: 152 microversion: 2.20 time: 0.036215 Jun 14 19:46:56.369731 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 303/634] 10.222.0.44 () {60 vars in 1288 bytes} [Tue Jun 14 19:46:56 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:46:56.484221 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-aabfbe9d-02b5-484b-b465-37bd9ca678af tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:56.485194 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-aabfbe9d-02b5-484b-b465-37bd9ca678af tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:56.492838 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aabfbe9d-02b5-484b-b465-37bd9ca678af tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:56.493260 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aabfbe9d-02b5-484b-b465-37bd9ca678af tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:56.494046 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aabfbe9d-02b5-484b-b465-37bd9ca678af tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:56.494471 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-aabfbe9d-02b5-484b-b465-37bd9ca678af tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:56.656762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-aabfbe9d-02b5-484b-b465-37bd9ca678af tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:56.664907 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-aabfbe9d-02b5-484b-b465-37bd9ca678af tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1362 microversion: 2.1 time: 0.185963 Jun 14 19:46:56.666008 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 332/635] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:56 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:56.740745 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-097af749-4bf4-44da-92b7-f29a958200a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:56.741360 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-097af749-4bf4-44da-92b7-f29a958200a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:56.747246 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-097af749-4bf4-44da-92b7-f29a958200a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:56.747686 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-097af749-4bf4-44da-92b7-f29a958200a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:56.748437 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-097af749-4bf4-44da-92b7-f29a958200a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:56.748864 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-097af749-4bf4-44da-92b7-f29a958200a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:56.867947 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d3124ee5-e27c-4a99-9d36-e84cf336db31 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:56.868552 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d3124ee5-e27c-4a99-9d36-e84cf336db31 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:56.874553 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d3124ee5-e27c-4a99-9d36-e84cf336db31 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:56.874997 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d3124ee5-e27c-4a99-9d36-e84cf336db31 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:56.875757 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d3124ee5-e27c-4a99-9d36-e84cf336db31 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:56.876185 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d3124ee5-e27c-4a99-9d36-e84cf336db31 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:56.881647 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-097af749-4bf4-44da-92b7-f29a958200a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:56.889146 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-097af749-4bf4-44da-92b7-f29a958200a3 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1367 microversion: 2.1 time: 0.152908 Jun 14 19:46:56.889822 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 304/636] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:56 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:56.913655 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-01f506f6-31d6-46f6-b21c-e21ad3b6c045 req-46ac15b8-748b-492f-86d8-9a2738d13c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55328760-5eb8-4c2b-bed1-b75b972100a7", "name": "network-vif-plugged", "status": "completed", "tag": "89baf037-10a7-4dc8-9634-4882cccec5be"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:56.922325 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-01f506f6-31d6-46f6-b21c-e21ad3b6c045 req-46ac15b8-748b-492f-86d8-9a2738d13c15 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:56.922770 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-01f506f6-31d6-46f6-b21c-e21ad3b6c045 req-46ac15b8-748b-492f-86d8-9a2738d13c15 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:56.935600 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-01f506f6-31d6-46f6-b21c-e21ad3b6c045 req-46ac15b8-748b-492f-86d8-9a2738d13c15 service nova] Creating event network-vif-plugged:89baf037-10a7-4dc8-9634-4882cccec5be for instance 55328760-5eb8-4c2b-bed1-b75b972100a7 on hv-cinder-84580 Jun 14 19:46:56.941052 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-01f506f6-31d6-46f6-b21c-e21ad3b6c045 req-46ac15b8-748b-492f-86d8-9a2738d13c15 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031509 Jun 14 19:46:56.942041 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 305/637] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:46:57.010006 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d3124ee5-e27c-4a99-9d36-e84cf336db31 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:57.017314 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d3124ee5-e27c-4a99-9d36-e84cf336db31 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1686 microversion: 2.1 time: 0.153292 Jun 14 19:46:57.017915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 333/638] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:56 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:46:57.682641 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-94f9b3e8-71df-4a6c-87e8-221bfe695136 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:57.683343 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-94f9b3e8-71df-4a6c-87e8-221bfe695136 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:57.685807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:57.686560 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=10 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:57.693469 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-94f9b3e8-71df-4a6c-87e8-221bfe695136 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:57.693928 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-94f9b3e8-71df-4a6c-87e8-221bfe695136 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:57.694684 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-94f9b3e8-71df-4a6c-87e8-221bfe695136 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:57.695113 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-94f9b3e8-71df-4a6c-87e8-221bfe695136 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:57.825565 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-94f9b3e8-71df-4a6c-87e8-221bfe695136 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:57.832988 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-94f9b3e8-71df-4a6c-87e8-221bfe695136 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1362 microversion: 2.1 time: 0.154592 Jun 14 19:46:57.833587 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 306/639] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:57 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:57.906249 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-23f3acb2-0705-439c-8cea-57c69abae25d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:57.906889 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-23f3acb2-0705-439c-8cea-57c69abae25d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:57.908846 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:57.910005 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=14 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:57.916427 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-23f3acb2-0705-439c-8cea-57c69abae25d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:57.916872 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-23f3acb2-0705-439c-8cea-57c69abae25d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:57.917663 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-23f3acb2-0705-439c-8cea-57c69abae25d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:57.918096 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-23f3acb2-0705-439c-8cea-57c69abae25d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:58.035537 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-64ee90f7-6deb-485a-8f06-0ac282a64962 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:58.036286 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-64ee90f7-6deb-485a-8f06-0ac282a64962 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:58.042985 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-64ee90f7-6deb-485a-8f06-0ac282a64962 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:58.043437 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-64ee90f7-6deb-485a-8f06-0ac282a64962 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:58.044209 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-64ee90f7-6deb-485a-8f06-0ac282a64962 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:58.044639 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-64ee90f7-6deb-485a-8f06-0ac282a64962 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:58.045133 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-23f3acb2-0705-439c-8cea-57c69abae25d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:58.052624 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-23f3acb2-0705-439c-8cea-57c69abae25d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1367 microversion: 2.1 time: 0.150169 Jun 14 19:46:58.053233 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 334/640] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:57 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:58.176887 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-64ee90f7-6deb-485a-8f06-0ac282a64962 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:58.184819 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-64ee90f7-6deb-485a-8f06-0ac282a64962 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1686 microversion: 2.1 time: 0.153155 Jun 14 19:46:58.185390 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 307/641] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:58 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:46:58.850882 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f9aff2cb-a652-4d67-8bce-c59f5df822aa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:58.851541 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f9aff2cb-a652-4d67-8bce-c59f5df822aa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:58.857622 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f9aff2cb-a652-4d67-8bce-c59f5df822aa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:58.858067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f9aff2cb-a652-4d67-8bce-c59f5df822aa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:58.858813 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f9aff2cb-a652-4d67-8bce-c59f5df822aa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:58.859238 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f9aff2cb-a652-4d67-8bce-c59f5df822aa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:58.988765 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-f9aff2cb-a652-4d67-8bce-c59f5df822aa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:58.996161 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f9aff2cb-a652-4d67-8bce-c59f5df822aa tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1362 microversion: 2.1 time: 0.150134 Jun 14 19:46:58.996795 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 335/642] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:58 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:59.069999 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-623be011-836b-4fd6-92a5-299dc63c87f2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:59.070536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-623be011-836b-4fd6-92a5-299dc63c87f2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:59.072989 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:59.078395 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-623be011-836b-4fd6-92a5-299dc63c87f2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:59.078839 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-623be011-836b-4fd6-92a5-299dc63c87f2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:59.079593 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-623be011-836b-4fd6-92a5-299dc63c87f2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:59.080023 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-623be011-836b-4fd6-92a5-299dc63c87f2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:59.202410 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e285767b-7e32-4ca8-a819-88261760c32d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:59.203119 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e285767b-7e32-4ca8-a819-88261760c32d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:59.209983 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e285767b-7e32-4ca8-a819-88261760c32d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:59.210240 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-623be011-836b-4fd6-92a5-299dc63c87f2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:59.210429 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e285767b-7e32-4ca8-a819-88261760c32d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:59.211189 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e285767b-7e32-4ca8-a819-88261760c32d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:59.211613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e285767b-7e32-4ca8-a819-88261760c32d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:59.217892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-623be011-836b-4fd6-92a5-299dc63c87f2 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1367 microversion: 2.1 time: 0.152455 Jun 14 19:46:59.218460 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 308/643] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:59 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:46:59.282143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6d6f20a1-ecc4-40a2-8e52-06177d9009d0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:46:59.282682 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-6d6f20a1-ecc4-40a2-8e52-06177d9009d0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:59.289888 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6d6f20a1-ecc4-40a2-8e52-06177d9009d0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:59.290879 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6d6f20a1-ecc4-40a2-8e52-06177d9009d0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:59.291095 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6d6f20a1-ecc4-40a2-8e52-06177d9009d0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:59.291526 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6d6f20a1-ecc4-40a2-8e52-06177d9009d0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:59.316241 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.objects.instance [None req-6d6f20a1-ecc4-40a2-8e52-06177d9009d0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lazy-loading 'flavor' on Instance uuid 574d3163-12b7-4f68-9f90-445a0d1b0b8e {{(pid=124069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:46:59.356895 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-e285767b-7e32-4ca8-a819-88261760c32d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:59.366210 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e285767b-7e32-4ca8-a819-88261760c32d tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1686 microversion: 2.1 time: 0.166579 Jun 14 19:46:59.366904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 336/644] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:46:59 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:46:59.582777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6d6f20a1-ecc4-40a2-8e52-06177d9009d0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "POST /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e/action" status: 202 len: 0 microversion: 2.20 time: 0.363133 Jun 14 19:46:59.583405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 309/645] 10.222.0.44 () {62 vars in 1318 bytes} [Tue Jun 14 19:46:59 2022] POST /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:46:59.591501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-fafce017-712e-4da7-89bd-1bf2587e7a19 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:46:59.592131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-fafce017-712e-4da7-89bd-1bf2587e7a19 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:46:59.598077 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fafce017-712e-4da7-89bd-1bf2587e7a19 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:59.598521 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fafce017-712e-4da7-89bd-1bf2587e7a19 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:59.599877 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fafce017-712e-4da7-89bd-1bf2587e7a19 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:46:59.600303 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fafce017-712e-4da7-89bd-1bf2587e7a19 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:46:59.726938 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-fafce017-712e-4da7-89bd-1bf2587e7a19 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:59.734722 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-fafce017-712e-4da7-89bd-1bf2587e7a19 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:59.736203 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-fafce017-712e-4da7-89bd-1bf2587e7a19 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:46:59.737338 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-fafce017-712e-4da7-89bd-1bf2587e7a19 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.149779 Jun 14 19:46:59.737912 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 337/646] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:46:59 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:00.013512 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-47aff2e4-3842-479b-b185-a225fda55dcf tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:00.014214 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-47aff2e4-3842-479b-b185-a225fda55dcf tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:00.020485 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-47aff2e4-3842-479b-b185-a225fda55dcf tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:00.021498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-47aff2e4-3842-479b-b185-a225fda55dcf tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:00.022250 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-47aff2e4-3842-479b-b185-a225fda55dcf tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:00.022681 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-47aff2e4-3842-479b-b185-a225fda55dcf tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:00.155055 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-47aff2e4-3842-479b-b185-a225fda55dcf tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:00.163923 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-47aff2e4-3842-479b-b185-a225fda55dcf tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1362 microversion: 2.1 time: 0.154752 Jun 14 19:47:00.164759 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 310/647] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:00 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:00.235123 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-336752eb-11dc-4bbb-97dd-94e609703852 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:00.235757 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-336752eb-11dc-4bbb-97dd-94e609703852 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:00.242462 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-336752eb-11dc-4bbb-97dd-94e609703852 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:00.242906 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-336752eb-11dc-4bbb-97dd-94e609703852 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:00.243746 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-336752eb-11dc-4bbb-97dd-94e609703852 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:00.244179 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-336752eb-11dc-4bbb-97dd-94e609703852 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:00.385419 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-e3643e37-ea83-4afc-afc2-3a3d1483ee14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:00.386349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-e3643e37-ea83-4afc-afc2-3a3d1483ee14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:00.393523 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e3643e37-ea83-4afc-afc2-3a3d1483ee14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:00.393523 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e3643e37-ea83-4afc-afc2-3a3d1483ee14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:00.393821 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e3643e37-ea83-4afc-afc2-3a3d1483ee14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:00.394159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e3643e37-ea83-4afc-afc2-3a3d1483ee14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:00.443214 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-336752eb-11dc-4bbb-97dd-94e609703852 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:00.453641 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-336752eb-11dc-4bbb-97dd-94e609703852 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1556 microversion: 2.1 time: 0.222041 Jun 14 19:47:00.454400 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 338/648] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:00 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1556 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:00.470234 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-8b5566ce-903c-4803-9c8c-f9701dd2f6c8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:00.470740 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8b5566ce-903c-4803-9c8c-f9701dd2f6c8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:00.478237 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8b5566ce-903c-4803-9c8c-f9701dd2f6c8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:00.478683 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8b5566ce-903c-4803-9c8c-f9701dd2f6c8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:00.479438 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8b5566ce-903c-4803-9c8c-f9701dd2f6c8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:00.479861 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8b5566ce-903c-4803-9c8c-f9701dd2f6c8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:00.558167 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-8b5566ce-903c-4803-9c8c-f9701dd2f6c8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091619 Jun 14 19:47:00.558785 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 339/649] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 14 19:47:00 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:00.609788 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e3643e37-ea83-4afc-afc2-3a3d1483ee14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:00.618540 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-e3643e37-ea83-4afc-afc2-3a3d1483ee14 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1686 microversion: 2.1 time: 0.238088 Jun 14 19:47:00.619494 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 311/650] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:00 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1686 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:00.756849 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-6378db83-0337-4029-a79a-3d4071ac3a11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:00.757447 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-6378db83-0337-4029-a79a-3d4071ac3a11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:00.763678 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6378db83-0337-4029-a79a-3d4071ac3a11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:00.764122 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6378db83-0337-4029-a79a-3d4071ac3a11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:00.764878 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6378db83-0337-4029-a79a-3d4071ac3a11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:00.765333 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6378db83-0337-4029-a79a-3d4071ac3a11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:01.032119 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-6378db83-0337-4029-a79a-3d4071ac3a11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:01.043776 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-6378db83-0337-4029-a79a-3d4071ac3a11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:01.045480 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-6378db83-0337-4029-a79a-3d4071ac3a11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:01.046654 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-6378db83-0337-4029-a79a-3d4071ac3a11 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.294309 Jun 14 19:47:01.047409 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 340/651] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:00 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:01.162469 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-92087293-f782-43f7-a33e-98253a551aff req-e95ab16d-dbbc-4150-b4b2-2715f64c7989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e845044c-b4e8-462f-abf8-0301476ec285", "name": "network-vif-deleted", "tag": "dcc13ad8-c81f-4feb-9c9c-0a5b20e3af4e"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:01.171781 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-92087293-f782-43f7-a33e-98253a551aff req-e95ab16d-dbbc-4150-b4b2-2715f64c7989 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:01.172159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-92087293-f782-43f7-a33e-98253a551aff req-e95ab16d-dbbc-4150-b4b2-2715f64c7989 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:01.181009 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-bd2092f8-2989-44f3-9545-d0068c63ba5c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:01.181725 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-bd2092f8-2989-44f3-9545-d0068c63ba5c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:01.186763 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-92087293-f782-43f7-a33e-98253a551aff req-e95ab16d-dbbc-4150-b4b2-2715f64c7989 service nova] Creating event network-vif-deleted:dcc13ad8-c81f-4feb-9c9c-0a5b20e3af4e for instance e845044c-b4e8-462f-abf8-0301476ec285 on hv-cinder-84580 Jun 14 19:47:01.194042 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-92087293-f782-43f7-a33e-98253a551aff req-e95ab16d-dbbc-4150-b4b2-2715f64c7989 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035806 Jun 14 19:47:01.194663 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 312/652] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:01.196609 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-bd2092f8-2989-44f3-9545-d0068c63ba5c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:01.197053 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-bd2092f8-2989-44f3-9545-d0068c63ba5c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:01.197843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-bd2092f8-2989-44f3-9545-d0068c63ba5c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:01.198278 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-bd2092f8-2989-44f3-9545-d0068c63ba5c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:01.627206 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-bd2092f8-2989-44f3-9545-d0068c63ba5c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:01.636824 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2b4856fe-9e60-4641-a42f-6019ab74a89a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:01.637875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2b4856fe-9e60-4641-a42f-6019ab74a89a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:01.644788 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2b4856fe-9e60-4641-a42f-6019ab74a89a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:01.645233 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2b4856fe-9e60-4641-a42f-6019ab74a89a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:01.646600 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2b4856fe-9e60-4641-a42f-6019ab74a89a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:01.651415 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-bd2092f8-2989-44f3-9545-d0068c63ba5c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1362 microversion: 2.1 time: 0.475049 Jun 14 19:47:01.652000 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 341/653] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:01 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1362 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:01.652668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2b4856fe-9e60-4641-a42f-6019ab74a89a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:01.687976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2b4856fe-9e60-4641-a42f-6019ab74a89a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:01.688418 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2b4856fe-9e60-4641-a42f-6019ab74a89a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:01.688861 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.objects.instance [None req-2b4856fe-9e60-4641-a42f-6019ab74a89a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lazy-loading 'fault' on Instance uuid e845044c-b4e8-462f-abf8-0301476ec285 {{(pid=124069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:47:01.735120 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2b4856fe-9e60-4641-a42f-6019ab74a89a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:01.743197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2b4856fe-9e60-4641-a42f-6019ab74a89a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 200 len: 1334 microversion: 2.1 time: 0.110543 Jun 14 19:47:01.747403 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 313/654] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:01 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 1334 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:47:01.946932 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-b5af55e1-5529-4ea6-b75f-d7849839c5a4 req-5fa2faf3-8f83-4adc-a2ec-4905a9823e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "906a717b-f3cc-4340-b6b6-7c47ef2ac058", "tag": "53b179df-e11d-45d1-a96c-7a7732926650"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:01.956343 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-b5af55e1-5529-4ea6-b75f-d7849839c5a4 req-5fa2faf3-8f83-4adc-a2ec-4905a9823e31 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:01.956980 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-b5af55e1-5529-4ea6-b75f-d7849839c5a4 req-5fa2faf3-8f83-4adc-a2ec-4905a9823e31 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:01.969453 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-b5af55e1-5529-4ea6-b75f-d7849839c5a4 req-5fa2faf3-8f83-4adc-a2ec-4905a9823e31 service nova] Creating event network-changed:53b179df-e11d-45d1-a96c-7a7732926650 for instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 on hv-cinder-84580 Jun 14 19:47:01.974297 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-b5af55e1-5529-4ea6-b75f-d7849839c5a4 req-5fa2faf3-8f83-4adc-a2ec-4905a9823e31 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032161 Jun 14 19:47:01.974885 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 342/655] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:02.065794 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8e7b70c9-f10d-4dfa-ac2c-cbc1133513ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:02.066538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8e7b70c9-f10d-4dfa-ac2c-cbc1133513ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:02.073696 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e7b70c9-f10d-4dfa-ac2c-cbc1133513ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:02.074653 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e7b70c9-f10d-4dfa-ac2c-cbc1133513ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:02.075513 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e7b70c9-f10d-4dfa-ac2c-cbc1133513ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:02.075924 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8e7b70c9-f10d-4dfa-ac2c-cbc1133513ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:02.210766 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8e7b70c9-f10d-4dfa-ac2c-cbc1133513ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:02.225298 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8e7b70c9-f10d-4dfa-ac2c-cbc1133513ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:02.226946 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8e7b70c9-f10d-4dfa-ac2c-cbc1133513ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:02.228257 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8e7b70c9-f10d-4dfa-ac2c-cbc1133513ca tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.166292 Jun 14 19:47:02.228903 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 314/656] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:02 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:02.669907 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-13114283-5e4e-4740-b397-73c7385c0311 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:02.671701 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-13114283-5e4e-4740-b397-73c7385c0311 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:02.680536 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-13114283-5e4e-4740-b397-73c7385c0311 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:02.681172 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-13114283-5e4e-4740-b397-73c7385c0311 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:02.682082 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-13114283-5e4e-4740-b397-73c7385c0311 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:02.682620 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-13114283-5e4e-4740-b397-73c7385c0311 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:02.761220 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6e784b75-76a2-4185-8dd4-82c0629d24d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:02.762724 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-6e784b75-76a2-4185-8dd4-82c0629d24d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: e845044c-b4e8-462f-abf8-0301476ec285] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:02.778799 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6e784b75-76a2-4185-8dd4-82c0629d24d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:02.779337 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6e784b75-76a2-4185-8dd4-82c0629d24d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:02.780223 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6e784b75-76a2-4185-8dd4-82c0629d24d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:02.780764 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6e784b75-76a2-4185-8dd4-82c0629d24d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:02.796855 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-6e784b75-76a2-4185-8dd4-82c0629d24d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] HTTP exception thrown: Instance e845044c-b4e8-462f-abf8-0301476ec285 could not be found. Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6e784b75-76a2-4185-8dd4-82c0629d24d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Request method failure captured: Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 HTTP/1.1 Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSXUwwI56eYhwPi9XEqhROraEksfHEb5IhPTbtyoll9ykvqMufFEeOqcOjWlLfF0jHg3hjdxlHtwds_NUimsgWEGN2iosCI_kqST9tecc6ZQuwsF46IreezwH9Tsojmvc-hqied-ovexRJRO7Dbf74R8f-SimKcNP1P1U9zDqlYnTE Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: 05db8610cfa7449daeec7419d4f7ad6c Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1296840289 Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:47:02.798784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:47:02.800172 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05db8610cfa7449daeec7419d4f7ad6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_05db8610cfa7449daeec7419d4f7ad6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/05db8610cfa7449daeec7419d4f7ad6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05db8610cfa7449daeec7419d4f7ad6c"}]}] Jun 14 19:47:02.800172 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1296840289 Jun 14 19:47:02.800172 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: 05db8610cfa7449daeec7419d4f7ad6c Jun 14 19:47:02.800172 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1296840289 Jun 14 19:47:02.800172 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-ServerRescueNegativeTestJSON-1296840289-project Jun 14 19:47:02.800172 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:47:02.800172 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:47:02.800172 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 9b28c3b97f9f44148dd02f41509887e8 Jun 14 19:47:02.800172 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1296840289-project Jun 14 19:47:02.800172 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:47:02.800172 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance e845044c-b4e8-462f-abf8-0301476ec285 could not be found. Jun 14 19:47:02.800172 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': 'e845044c-b4e8-462f-abf8-0301476ec285'} Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e845044c-b4e8-462f-abf8-0301476ec285 could not be found. Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:47:02.800966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e845044c-b4e8-462f-abf8-0301476ec285 could not be found. Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e845044c-b4e8-462f-abf8-0301476ec285 could not be found. Jun 14 19:47:02.803202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:47:02.805482 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6e784b75-76a2-4185-8dd4-82c0629d24d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Returning 404 to user: Instance e845044c-b4e8-462f-abf8-0301476ec285 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:47:02.806497 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6e784b75-76a2-4185-8dd4-82c0629d24d2 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285" status: 404 len: 111 microversion: 2.1 time: 0.049758 Jun 14 19:47:02.807227 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 315/657] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:02 2022] GET /compute/v2.1/servers/e845044c-b4e8-462f-abf8-0301476ec285 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:47:02.821892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-944a029f-d939-4419-a8ba-e135795d73f6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '.version_select at 0x7f144b61a0d0>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:02.836968 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-13114283-5e4e-4740-b397-73c7385c0311 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:02.850924 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-13114283-5e4e-4740-b397-73c7385c0311 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1549 microversion: 2.1 time: 0.185457 Jun 14 19:47:02.852058 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 343/658] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:02 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1549 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:02.852888 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-944a029f-d939-4419-a8ba-e135795d73f6 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-362722115" status: 202 len: 0 microversion: 2.1 time: 0.035549 Jun 14 19:47:02.853539 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 316/659] 10.222.0.44 () {58 vars in 1217 bytes} [Tue Jun 14 19:47:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-362722115 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:47:02.869205 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4ae6c53d-612c-4609-b6d3-7e6afabe48dd tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:02.870017 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4ae6c53d-612c-4609-b6d3-7e6afabe48dd tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:02.876948 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4ae6c53d-612c-4609-b6d3-7e6afabe48dd tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:02.877577 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4ae6c53d-612c-4609-b6d3-7e6afabe48dd tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:02.878347 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4ae6c53d-612c-4609-b6d3-7e6afabe48dd tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:02.878782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4ae6c53d-612c-4609-b6d3-7e6afabe48dd tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:02.985882 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4ae6c53d-612c-4609-b6d3-7e6afabe48dd tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122442 Jun 14 19:47:02.986801 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 344/660] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 14 19:47:02 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:03.246960 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4628d298-b4a2-45be-b0fa-27c01536f840 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:03.247557 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4628d298-b4a2-45be-b0fa-27c01536f840 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:03.254561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4628d298-b4a2-45be-b0fa-27c01536f840 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:03.255505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4628d298-b4a2-45be-b0fa-27c01536f840 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:03.256634 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4628d298-b4a2-45be-b0fa-27c01536f840 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:03.257095 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4628d298-b4a2-45be-b0fa-27c01536f840 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:03.273256 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:03.504947 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4628d298-b4a2-45be-b0fa-27c01536f840 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:03.513200 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4628d298-b4a2-45be-b0fa-27c01536f840 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:03.514732 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4628d298-b4a2-45be-b0fa-27c01536f840 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:03.515883 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4628d298-b4a2-45be-b0fa-27c01536f840 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.273468 Jun 14 19:47:03.516622 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 317/661] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:03 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:04.018502 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-d641c643-def0-4c69-96c3-31246881caf5 req-20bf9b2c-7f93-4fdb-a924-480666d99cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55328760-5eb8-4c2b-bed1-b75b972100a7", "tag": "89baf037-10a7-4dc8-9634-4882cccec5be"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:04.027627 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-d641c643-def0-4c69-96c3-31246881caf5 req-20bf9b2c-7f93-4fdb-a924-480666d99cdc service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:04.028158 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-d641c643-def0-4c69-96c3-31246881caf5 req-20bf9b2c-7f93-4fdb-a924-480666d99cdc service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:04.044815 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-d641c643-def0-4c69-96c3-31246881caf5 req-20bf9b2c-7f93-4fdb-a924-480666d99cdc service nova] Creating event network-changed:89baf037-10a7-4dc8-9634-4882cccec5be for instance 55328760-5eb8-4c2b-bed1-b75b972100a7 on hv-cinder-84580 Jun 14 19:47:04.050405 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-d641c643-def0-4c69-96c3-31246881caf5 req-20bf9b2c-7f93-4fdb-a924-480666d99cdc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036109 Jun 14 19:47:04.051200 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 345/662] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:04.534902 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-eeda1f29-3190-4c43-84bb-d3fa9285b693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:04.535518 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-eeda1f29-3190-4c43-84bb-d3fa9285b693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:04.543090 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eeda1f29-3190-4c43-84bb-d3fa9285b693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:04.543610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eeda1f29-3190-4c43-84bb-d3fa9285b693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:04.544399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eeda1f29-3190-4c43-84bb-d3fa9285b693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:04.544835 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-eeda1f29-3190-4c43-84bb-d3fa9285b693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:04.962018 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-eeda1f29-3190-4c43-84bb-d3fa9285b693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:04.971809 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-eeda1f29-3190-4c43-84bb-d3fa9285b693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:04.973331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-eeda1f29-3190-4c43-84bb-d3fa9285b693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:04.975554 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-eeda1f29-3190-4c43-84bb-d3fa9285b693 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.443983 Jun 14 19:47:04.981925 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 318/663] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:04 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:05.828983 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-2af1233d-dbb3-49a3-ba95-ffccce7faa11 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:05.829584 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-2af1233d-dbb3-49a3-ba95-ffccce7faa11 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:05.836361 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2af1233d-dbb3-49a3-ba95-ffccce7faa11 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:05.836815 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2af1233d-dbb3-49a3-ba95-ffccce7faa11 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:05.837599 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2af1233d-dbb3-49a3-ba95-ffccce7faa11 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:05.838035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2af1233d-dbb3-49a3-ba95-ffccce7faa11 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:05.862377 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-2af1233d-dbb3-49a3-ba95-ffccce7faa11 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Going to try to terminate instance {{(pid=124068) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:47:05.893217 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:05.948897 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-2af1233d-dbb3-49a3-ba95-ffccce7faa11 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 204 len: 0 microversion: 2.1 time: 0.124245 Jun 14 19:47:05.949670 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 346/664] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:47:05 2022] DELETE /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:47:05.960692 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2564f5a3-7933-4395-a97f-492503fd481a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:05.961423 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2564f5a3-7933-4395-a97f-492503fd481a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:05.967782 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2564f5a3-7933-4395-a97f-492503fd481a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:05.968234 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2564f5a3-7933-4395-a97f-492503fd481a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:05.968999 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2564f5a3-7933-4395-a97f-492503fd481a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:05.969456 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2564f5a3-7933-4395-a97f-492503fd481a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:05.995022 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-72f0be58-cf70-4856-93de-3717f2b9c1ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:05.995816 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-72f0be58-cf70-4856-93de-3717f2b9c1ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:06.001824 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72f0be58-cf70-4856-93de-3717f2b9c1ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:06.002351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72f0be58-cf70-4856-93de-3717f2b9c1ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:06.003239 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72f0be58-cf70-4856-93de-3717f2b9c1ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:06.003732 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72f0be58-cf70-4856-93de-3717f2b9c1ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:06.098236 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2564f5a3-7933-4395-a97f-492503fd481a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:06.106585 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2564f5a3-7933-4395-a97f-492503fd481a tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1506 microversion: 2.1 time: 0.151342 Jun 14 19:47:06.107157 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 319/665] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:05 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:47:06.149890 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-72f0be58-cf70-4856-93de-3717f2b9c1ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:06.157814 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-72f0be58-cf70-4856-93de-3717f2b9c1ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:06.159325 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-72f0be58-cf70-4856-93de-3717f2b9c1ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:06.160473 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-72f0be58-cf70-4856-93de-3717f2b9c1ee tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.169832 Jun 14 19:47:06.161062 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 347/666] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:05 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:47:07.122995 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d1edc14e-eb0c-45f0-9108-9e2eefed8286 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:07.123542 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d1edc14e-eb0c-45f0-9108-9e2eefed8286 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:07.130353 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d1edc14e-eb0c-45f0-9108-9e2eefed8286 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:07.130803 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d1edc14e-eb0c-45f0-9108-9e2eefed8286 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:07.131559 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d1edc14e-eb0c-45f0-9108-9e2eefed8286 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:07.131992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d1edc14e-eb0c-45f0-9108-9e2eefed8286 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:07.178454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1548ebf6-7d9d-49eb-9fd1-f7a0ca2c0cab tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:07.179066 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1548ebf6-7d9d-49eb-9fd1-f7a0ca2c0cab tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:07.185079 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1548ebf6-7d9d-49eb-9fd1-f7a0ca2c0cab tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:07.185575 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1548ebf6-7d9d-49eb-9fd1-f7a0ca2c0cab tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:07.186335 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1548ebf6-7d9d-49eb-9fd1-f7a0ca2c0cab tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:07.186769 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1548ebf6-7d9d-49eb-9fd1-f7a0ca2c0cab tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:07.265055 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d1edc14e-eb0c-45f0-9108-9e2eefed8286 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:07.273654 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d1edc14e-eb0c-45f0-9108-9e2eefed8286 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1506 microversion: 2.1 time: 0.154452 Jun 14 19:47:07.274505 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 320/667] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:07 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:07.316379 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1548ebf6-7d9d-49eb-9fd1-f7a0ca2c0cab tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:07.324186 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1548ebf6-7d9d-49eb-9fd1-f7a0ca2c0cab tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:07.325725 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1548ebf6-7d9d-49eb-9fd1-f7a0ca2c0cab tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:07.326879 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1548ebf6-7d9d-49eb-9fd1-f7a0ca2c0cab tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.152996 Jun 14 19:47:07.327431 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 348/668] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:07 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:47:08.291230 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-dc2d3959-5c49-498c-801b-1f60c4deea94 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:08.291836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-dc2d3959-5c49-498c-801b-1f60c4deea94 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:08.298654 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dc2d3959-5c49-498c-801b-1f60c4deea94 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:08.299093 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dc2d3959-5c49-498c-801b-1f60c4deea94 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:08.299843 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dc2d3959-5c49-498c-801b-1f60c4deea94 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:08.300270 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dc2d3959-5c49-498c-801b-1f60c4deea94 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:08.345681 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d488996f-5b79-4d5e-b3ea-c4882a8caec4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:08.346282 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d488996f-5b79-4d5e-b3ea-c4882a8caec4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:08.352931 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d488996f-5b79-4d5e-b3ea-c4882a8caec4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:08.353388 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d488996f-5b79-4d5e-b3ea-c4882a8caec4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:08.354160 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d488996f-5b79-4d5e-b3ea-c4882a8caec4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:08.354602 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d488996f-5b79-4d5e-b3ea-c4882a8caec4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:08.485629 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d488996f-5b79-4d5e-b3ea-c4882a8caec4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:08.494188 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d488996f-5b79-4d5e-b3ea-c4882a8caec4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:08.495707 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d488996f-5b79-4d5e-b3ea-c4882a8caec4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:08.496861 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d488996f-5b79-4d5e-b3ea-c4882a8caec4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.154976 Jun 14 19:47:08.497440 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 349/669] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:08 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:47:08.531139 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-dc2d3959-5c49-498c-801b-1f60c4deea94 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:08.539530 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-dc2d3959-5c49-498c-801b-1f60c4deea94 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 200 len: 1506 microversion: 2.1 time: 0.252287 Jun 14 19:47:08.540116 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 321/670] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:08 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:08.797702 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-ba82a4e0-6f64-4565-92a8-fee793ae9e0a req-4af2b9bf-da62-490c-bd73-7dc50797cf2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc5647b9-307a-4287-be2e-34a8aa3703ba", "name": "network-vif-deleted", "tag": "8f6e7c67-b95a-4af1-86b0-33adfaffdfd6"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:08.810142 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-ba82a4e0-6f64-4565-92a8-fee793ae9e0a req-4af2b9bf-da62-490c-bd73-7dc50797cf2b service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:08.810856 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-ba82a4e0-6f64-4565-92a8-fee793ae9e0a req-4af2b9bf-da62-490c-bd73-7dc50797cf2b service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:08.826384 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-ba82a4e0-6f64-4565-92a8-fee793ae9e0a req-4af2b9bf-da62-490c-bd73-7dc50797cf2b service nova] Creating event network-vif-deleted:8f6e7c67-b95a-4af1-86b0-33adfaffdfd6 for instance bc5647b9-307a-4287-be2e-34a8aa3703ba on hv-cinder-84580 Jun 14 19:47:08.831454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-ba82a4e0-6f64-4565-92a8-fee793ae9e0a req-4af2b9bf-da62-490c-bd73-7dc50797cf2b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037524 Jun 14 19:47:08.832253 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 350/671] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:09.514986 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d7aac1a0-72af-49e1-9b7c-f201a11e0b39 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:09.515593 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d7aac1a0-72af-49e1-9b7c-f201a11e0b39 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:09.522730 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d7aac1a0-72af-49e1-9b7c-f201a11e0b39 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:09.523181 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d7aac1a0-72af-49e1-9b7c-f201a11e0b39 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:09.523939 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d7aac1a0-72af-49e1-9b7c-f201a11e0b39 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:09.524635 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d7aac1a0-72af-49e1-9b7c-f201a11e0b39 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:09.557004 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-985c39d6-635e-4141-b78a-d19b8cbf9e46 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:09.557729 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-985c39d6-635e-4141-b78a-d19b8cbf9e46 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: bc5647b9-307a-4287-be2e-34a8aa3703ba] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:09.564474 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-985c39d6-635e-4141-b78a-d19b8cbf9e46 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:09.564474 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-985c39d6-635e-4141-b78a-d19b8cbf9e46 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:09.565244 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-985c39d6-635e-4141-b78a-d19b8cbf9e46 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:09.565706 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-985c39d6-635e-4141-b78a-d19b8cbf9e46 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:09.579319 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-985c39d6-635e-4141-b78a-d19b8cbf9e46 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] HTTP exception thrown: Instance bc5647b9-307a-4287-be2e-34a8aa3703ba could not be found. Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-985c39d6-635e-4141-b78a-d19b8cbf9e46 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Request method failure captured: Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba HTTP/1.1 Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOSXUwwI56eYhwPi9XEqhROraEksfHEb5IhPTbtyoll9ykvqMufFEeOqcOjWlLfF0jHg3hjdxlHtwds_NUimsgWEGN2iosCI_kqST9tecc6ZQuwsF46IreezwH9Tsojmvc-hqied-ovexRJRO7Dbf74R8f-SimKcNP1P1U9zDqlYnTE Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: 05db8610cfa7449daeec7419d4f7ad6c Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1296840289 Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:47:09.580953 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:47:09.582426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05db8610cfa7449daeec7419d4f7ad6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_05db8610cfa7449daeec7419d4f7ad6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/05db8610cfa7449daeec7419d4f7ad6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05db8610cfa7449daeec7419d4f7ad6c"}]}] Jun 14 19:47:09.582426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1296840289 Jun 14 19:47:09.582426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: 05db8610cfa7449daeec7419d4f7ad6c Jun 14 19:47:09.582426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1296840289 Jun 14 19:47:09.582426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-ServerRescueNegativeTestJSON-1296840289-project Jun 14 19:47:09.582426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:47:09.582426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:47:09.582426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 9b28c3b97f9f44148dd02f41509887e8 Jun 14 19:47:09.582426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1296840289-project Jun 14 19:47:09.582426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:47:09.582426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance bc5647b9-307a-4287-be2e-34a8aa3703ba could not be found. Jun 14 19:47:09.582426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': 'bc5647b9-307a-4287-be2e-34a8aa3703ba'} Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc5647b9-307a-4287-be2e-34a8aa3703ba could not be found. Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:47:09.583187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc5647b9-307a-4287-be2e-34a8aa3703ba could not be found. Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc5647b9-307a-4287-be2e-34a8aa3703ba could not be found. Jun 14 19:47:09.584328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:47:09.586280 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-985c39d6-635e-4141-b78a-d19b8cbf9e46 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Returning 404 to user: Instance bc5647b9-307a-4287-be2e-34a8aa3703ba could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:47:09.586280 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-985c39d6-635e-4141-b78a-d19b8cbf9e46 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba" status: 404 len: 111 microversion: 2.1 time: 0.030105 Jun 14 19:47:09.586280 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 351/672] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:09 2022] GET /compute/v2.1/servers/bc5647b9-307a-4287-be2e-34a8aa3703ba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 19:47:09.590951 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-8e361649-84cd-447f-bf8c-9fdf02af4689 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:09.591473 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8e361649-84cd-447f-bf8c-9fdf02af4689 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:09.593310 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:09.598706 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8e361649-84cd-447f-bf8c-9fdf02af4689 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:09.599155 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8e361649-84cd-447f-bf8c-9fdf02af4689 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:09.599919 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8e361649-84cd-447f-bf8c-9fdf02af4689 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:09.600920 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8e361649-84cd-447f-bf8c-9fdf02af4689 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:09.627505 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8e361649-84cd-447f-bf8c-9fdf02af4689 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Going to try to terminate instance {{(pid=124068) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:47:09.661090 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d7aac1a0-72af-49e1-9b7c-f201a11e0b39 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:09.669942 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d7aac1a0-72af-49e1-9b7c-f201a11e0b39 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:09.671453 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d7aac1a0-72af-49e1-9b7c-f201a11e0b39 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:09.672615 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d7aac1a0-72af-49e1-9b7c-f201a11e0b39 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.161580 Jun 14 19:47:09.673181 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 322/673] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:09 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:09.704602 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-8e361649-84cd-447f-bf8c-9fdf02af4689 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "DELETE /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 204 len: 0 microversion: 2.1 time: 0.116970 Jun 14 19:47:09.705391 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 352/674] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:47:09 2022] DELETE /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 14 19:47:09.714034 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4659bdef-b681-4e10-8593-0c7a68151ac3 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:09.714648 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4659bdef-b681-4e10-8593-0c7a68151ac3 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:09.720676 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4659bdef-b681-4e10-8593-0c7a68151ac3 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:09.721125 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4659bdef-b681-4e10-8593-0c7a68151ac3 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:09.721910 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4659bdef-b681-4e10-8593-0c7a68151ac3 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:09.722349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4659bdef-b681-4e10-8593-0c7a68151ac3 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:09.852819 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4659bdef-b681-4e10-8593-0c7a68151ac3 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:09.860355 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4659bdef-b681-4e10-8593-0c7a68151ac3 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.150835 Jun 14 19:47:09.860918 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 323/675] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:09 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:10.692312 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-583c53dd-494d-48be-afa1-f00e42a2814b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:10.692992 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-583c53dd-494d-48be-afa1-f00e42a2814b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:10.699607 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-583c53dd-494d-48be-afa1-f00e42a2814b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:10.700045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-583c53dd-494d-48be-afa1-f00e42a2814b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:10.701078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-583c53dd-494d-48be-afa1-f00e42a2814b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:10.701540 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-583c53dd-494d-48be-afa1-f00e42a2814b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:10.831955 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-583c53dd-494d-48be-afa1-f00e42a2814b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:10.839850 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-583c53dd-494d-48be-afa1-f00e42a2814b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:10.841334 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-583c53dd-494d-48be-afa1-f00e42a2814b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:10.842514 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-583c53dd-494d-48be-afa1-f00e42a2814b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.154413 Jun 14 19:47:10.843060 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 353/676] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:10 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:10.877260 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-5892078f-9fc5-48d0-8d19-10e84d1d6b76 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:10.877897 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-5892078f-9fc5-48d0-8d19-10e84d1d6b76 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:10.884357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5892078f-9fc5-48d0-8d19-10e84d1d6b76 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:10.884802 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5892078f-9fc5-48d0-8d19-10e84d1d6b76 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:10.885609 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5892078f-9fc5-48d0-8d19-10e84d1d6b76 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:10.886048 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5892078f-9fc5-48d0-8d19-10e84d1d6b76 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:11.014027 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-5892078f-9fc5-48d0-8d19-10e84d1d6b76 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:11.021359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-5892078f-9fc5-48d0-8d19-10e84d1d6b76 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.147892 Jun 14 19:47:11.023046 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 324/677] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:10 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:11.860990 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b622a6d3-ba19-4419-b099-b367b7285c53 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:11.861634 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b622a6d3-ba19-4419-b099-b367b7285c53 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:11.869087 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b622a6d3-ba19-4419-b099-b367b7285c53 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:11.869600 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b622a6d3-ba19-4419-b099-b367b7285c53 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:11.870490 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b622a6d3-ba19-4419-b099-b367b7285c53 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:11.870999 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b622a6d3-ba19-4419-b099-b367b7285c53 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:11.997742 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b622a6d3-ba19-4419-b099-b367b7285c53 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:12.005522 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b622a6d3-ba19-4419-b099-b367b7285c53 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:12.007691 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b622a6d3-ba19-4419-b099-b367b7285c53 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:12.008835 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b622a6d3-ba19-4419-b099-b367b7285c53 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.151780 Jun 14 19:47:12.009411 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 354/678] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:11 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:12.039794 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9a45fda0-0388-4b21-bf50-8a084ced90c0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:12.040410 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9a45fda0-0388-4b21-bf50-8a084ced90c0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:12.046993 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a45fda0-0388-4b21-bf50-8a084ced90c0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:12.047437 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a45fda0-0388-4b21-bf50-8a084ced90c0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:12.048192 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a45fda0-0388-4b21-bf50-8a084ced90c0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:12.048620 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a45fda0-0388-4b21-bf50-8a084ced90c0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:12.177685 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9a45fda0-0388-4b21-bf50-8a084ced90c0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:12.185671 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9a45fda0-0388-4b21-bf50-8a084ced90c0 tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.150194 Jun 14 19:47:12.186230 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 325/679] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:12 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:13.027404 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b3e4addd-3925-4e93-b055-e713773af271 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:13.028015 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b3e4addd-3925-4e93-b055-e713773af271 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:13.034524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b3e4addd-3925-4e93-b055-e713773af271 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:13.034971 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b3e4addd-3925-4e93-b055-e713773af271 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:13.035730 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b3e4addd-3925-4e93-b055-e713773af271 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:13.036162 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b3e4addd-3925-4e93-b055-e713773af271 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:13.180655 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b3e4addd-3925-4e93-b055-e713773af271 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:13.188821 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b3e4addd-3925-4e93-b055-e713773af271 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:13.190371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b3e4addd-3925-4e93-b055-e713773af271 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:13.191519 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b3e4addd-3925-4e93-b055-e713773af271 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.168334 Jun 14 19:47:13.192068 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 355/680] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:13 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:13.202711 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-06c98df1-78d4-46f3-90b2-141e2802b26e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:13.203170 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-06c98df1-78d4-46f3-90b2-141e2802b26e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:13.209661 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-06c98df1-78d4-46f3-90b2-141e2802b26e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:13.210146 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-06c98df1-78d4-46f3-90b2-141e2802b26e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:13.210904 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-06c98df1-78d4-46f3-90b2-141e2802b26e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:13.211329 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-06c98df1-78d4-46f3-90b2-141e2802b26e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:13.436476 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-06c98df1-78d4-46f3-90b2-141e2802b26e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b28c3b97f9f44148dd02f41509887e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db8610cfa7449daeec7419d4f7ad6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:13.444874 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-06c98df1-78d4-46f3-90b2-141e2802b26e tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 200 len: 1521 microversion: 2.1 time: 0.246136 Jun 14 19:47:13.445481 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 326/681] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:13 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:13.675745 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-f7fb10b6-c5c4-434b-9848-90b19eb1a66d req-f9d9872d-6a62-4df1-9df3-86950f12cdd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a2c03a-7157-4585-b388-ae3fbf9913cb", "name": "network-vif-deleted", "tag": "e694d355-bb65-4972-b8bc-9554650ef1ff"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:13.684106 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-f7fb10b6-c5c4-434b-9848-90b19eb1a66d req-f9d9872d-6a62-4df1-9df3-86950f12cdd3 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:13.684594 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-f7fb10b6-c5c4-434b-9848-90b19eb1a66d req-f9d9872d-6a62-4df1-9df3-86950f12cdd3 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:13.696300 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-f7fb10b6-c5c4-434b-9848-90b19eb1a66d req-f9d9872d-6a62-4df1-9df3-86950f12cdd3 service nova] Creating event network-vif-deleted:e694d355-bb65-4972-b8bc-9554650ef1ff for instance 26a2c03a-7157-4585-b388-ae3fbf9913cb on hv-cinder-84580 Jun 14 19:47:13.700928 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-f7fb10b6-c5c4-434b-9848-90b19eb1a66d req-f9d9872d-6a62-4df1-9df3-86950f12cdd3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094066 Jun 14 19:47:13.701634 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 356/682] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:14.210870 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8bf10a0e-d3a8-4d14-86a4-f66b3f0c1044 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:14.211386 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8bf10a0e-d3a8-4d14-86a4-f66b3f0c1044 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:14.217889 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8bf10a0e-d3a8-4d14-86a4-f66b3f0c1044 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:14.218336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8bf10a0e-d3a8-4d14-86a4-f66b3f0c1044 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:14.219093 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8bf10a0e-d3a8-4d14-86a4-f66b3f0c1044 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:14.219525 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8bf10a0e-d3a8-4d14-86a4-f66b3f0c1044 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:14.350487 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8bf10a0e-d3a8-4d14-86a4-f66b3f0c1044 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:14.358388 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8bf10a0e-d3a8-4d14-86a4-f66b3f0c1044 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:14.359925 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8bf10a0e-d3a8-4d14-86a4-f66b3f0c1044 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:14.361071 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8bf10a0e-d3a8-4d14-86a4-f66b3f0c1044 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.154936 Jun 14 19:47:14.361664 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 327/683] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:14 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:14.466425 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-529f4228-ad2d-49d5-bfa1-332602b9ccee tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:14.467074 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-529f4228-ad2d-49d5-bfa1-332602b9ccee tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] [instance: 26a2c03a-7157-4585-b388-ae3fbf9913cb] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:14.473192 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-529f4228-ad2d-49d5-bfa1-332602b9ccee tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:14.473677 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-529f4228-ad2d-49d5-bfa1-332602b9ccee tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:14.474435 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-529f4228-ad2d-49d5-bfa1-332602b9ccee tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:14.474869 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-529f4228-ad2d-49d5-bfa1-332602b9ccee tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:14.487678 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-529f4228-ad2d-49d5-bfa1-332602b9ccee tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] HTTP exception thrown: Instance 26a2c03a-7157-4585-b388-ae3fbf9913cb could not be found. Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-529f4228-ad2d-49d5-bfa1-332602b9ccee tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Request method failure captured: Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb HTTP/1.1 Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOSXUwwI56eYhwPi9XEqhROraEksfHEb5IhPTbtyoll9ykvqMufFEeOqcOjWlLfF0jHg3hjdxlHtwds_NUimsgWEGN2iosCI_kqST9tecc6ZQuwsF46IreezwH9Tsojmvc-hqied-ovexRJRO7Dbf74R8f-SimKcNP1P1U9zDqlYnTE Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: 05db8610cfa7449daeec7419d4f7ad6c Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1296840289 Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:47:14.489246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:47:14.490797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05db8610cfa7449daeec7419d4f7ad6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_05db8610cfa7449daeec7419d4f7ad6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/05db8610cfa7449daeec7419d4f7ad6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05db8610cfa7449daeec7419d4f7ad6c"}]}] Jun 14 19:47:14.490797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1296840289 Jun 14 19:47:14.490797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: 05db8610cfa7449daeec7419d4f7ad6c Jun 14 19:47:14.490797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1296840289 Jun 14 19:47:14.490797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-ServerRescueNegativeTestJSON-1296840289-project Jun 14 19:47:14.490797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:47:14.490797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:47:14.490797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 9b28c3b97f9f44148dd02f41509887e8 Jun 14 19:47:14.490797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1296840289-project Jun 14 19:47:14.490797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:47:14.490797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance 26a2c03a-7157-4585-b388-ae3fbf9913cb could not be found. Jun 14 19:47:14.490797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': '26a2c03a-7157-4585-b388-ae3fbf9913cb'} Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a2c03a-7157-4585-b388-ae3fbf9913cb could not be found. Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:47:14.491630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a2c03a-7157-4585-b388-ae3fbf9913cb could not be found. Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a2c03a-7157-4585-b388-ae3fbf9913cb could not be found. Jun 14 19:47:14.493001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:47:14.494317 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-529f4228-ad2d-49d5-bfa1-332602b9ccee tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] Returning 404 to user: Instance 26a2c03a-7157-4585-b388-ae3fbf9913cb could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:47:14.494317 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-529f4228-ad2d-49d5-bfa1-332602b9ccee tempest-ServerRescueNegativeTestJSON-1296840289 tempest-ServerRescueNegativeTestJSON-1296840289-project] 10.222.0.44 "GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb" status: 404 len: 111 microversion: 2.1 time: 0.028943 Jun 14 19:47:14.494317 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 357/684] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:14 2022] GET /compute/v2.1/servers/26a2c03a-7157-4585-b388-ae3fbf9913cb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:47:15.379191 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6b2613ba-2a42-427f-87c8-554ab2e631ae tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:15.379802 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-6b2613ba-2a42-427f-87c8-554ab2e631ae tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:15.387074 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6b2613ba-2a42-427f-87c8-554ab2e631ae tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:15.387526 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6b2613ba-2a42-427f-87c8-554ab2e631ae tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:15.388324 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6b2613ba-2a42-427f-87c8-554ab2e631ae tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:15.388759 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6b2613ba-2a42-427f-87c8-554ab2e631ae tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:15.523615 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-6b2613ba-2a42-427f-87c8-554ab2e631ae tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:15.535668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-6b2613ba-2a42-427f-87c8-554ab2e631ae tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:15.537596 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-6b2613ba-2a42-427f-87c8-554ab2e631ae tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:15.538927 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6b2613ba-2a42-427f-87c8-554ab2e631ae tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.163683 Jun 14 19:47:15.539488 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 328/685] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:15 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:16.557652 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b0dbeb89-cfaa-46ec-9b44-384fee9bb833 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:16.558059 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b0dbeb89-cfaa-46ec-9b44-384fee9bb833 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:16.564760 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b0dbeb89-cfaa-46ec-9b44-384fee9bb833 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:16.565415 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b0dbeb89-cfaa-46ec-9b44-384fee9bb833 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:16.566199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b0dbeb89-cfaa-46ec-9b44-384fee9bb833 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:16.566799 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b0dbeb89-cfaa-46ec-9b44-384fee9bb833 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:16.774820 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b0dbeb89-cfaa-46ec-9b44-384fee9bb833 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:16.785727 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b0dbeb89-cfaa-46ec-9b44-384fee9bb833 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:16.787923 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b0dbeb89-cfaa-46ec-9b44-384fee9bb833 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:16.789351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b0dbeb89-cfaa-46ec-9b44-384fee9bb833 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.235959 Jun 14 19:47:16.789926 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 358/686] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:16 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:47:17.808874 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-25b735bf-3fc9-4bcd-bdb4-0995ba7622be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:17.809527 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-25b735bf-3fc9-4bcd-bdb4-0995ba7622be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:17.816522 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-25b735bf-3fc9-4bcd-bdb4-0995ba7622be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:17.818326 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-25b735bf-3fc9-4bcd-bdb4-0995ba7622be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:17.819666 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-25b735bf-3fc9-4bcd-bdb4-0995ba7622be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:17.820137 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-25b735bf-3fc9-4bcd-bdb4-0995ba7622be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:17.992689 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-25b735bf-3fc9-4bcd-bdb4-0995ba7622be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:18.002491 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-25b735bf-3fc9-4bcd-bdb4-0995ba7622be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:18.003985 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-25b735bf-3fc9-4bcd-bdb4-0995ba7622be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:18.005140 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-25b735bf-3fc9-4bcd-bdb4-0995ba7622be tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.200757 Jun 14 19:47:18.009938 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 329/687] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:17 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:19.025758 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-471bc5f3-d306-4919-bd58-8fb31c473395 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:19.026532 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-471bc5f3-d306-4919-bd58-8fb31c473395 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:19.033293 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-471bc5f3-d306-4919-bd58-8fb31c473395 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:19.033916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-471bc5f3-d306-4919-bd58-8fb31c473395 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:19.034696 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-471bc5f3-d306-4919-bd58-8fb31c473395 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:19.035284 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-471bc5f3-d306-4919-bd58-8fb31c473395 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:19.172102 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-471bc5f3-d306-4919-bd58-8fb31c473395 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:19.180622 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-471bc5f3-d306-4919-bd58-8fb31c473395 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:19.182352 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-471bc5f3-d306-4919-bd58-8fb31c473395 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:19.183517 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-471bc5f3-d306-4919-bd58-8fb31c473395 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.163805 Jun 14 19:47:19.184070 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 359/688] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:19 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:20.202602 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-18595472-ab89-416e-95ae-ba553b82cca7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:20.203213 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-18595472-ab89-416e-95ae-ba553b82cca7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:20.210027 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-18595472-ab89-416e-95ae-ba553b82cca7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:20.210483 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-18595472-ab89-416e-95ae-ba553b82cca7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:20.211246 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-18595472-ab89-416e-95ae-ba553b82cca7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:20.211672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-18595472-ab89-416e-95ae-ba553b82cca7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:20.352321 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-18595472-ab89-416e-95ae-ba553b82cca7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:20.360528 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-18595472-ab89-416e-95ae-ba553b82cca7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:20.362060 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-18595472-ab89-416e-95ae-ba553b82cca7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:20.363216 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-18595472-ab89-416e-95ae-ba553b82cca7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.165752 Jun 14 19:47:20.363777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 330/689] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:20 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:21.382232 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3dc0c574-c3d7-4ad2-aa83-c1a447687bb3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:21.382846 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3dc0c574-c3d7-4ad2-aa83-c1a447687bb3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:21.389222 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3dc0c574-c3d7-4ad2-aa83-c1a447687bb3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:21.389728 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3dc0c574-c3d7-4ad2-aa83-c1a447687bb3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:21.390489 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3dc0c574-c3d7-4ad2-aa83-c1a447687bb3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:21.390982 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3dc0c574-c3d7-4ad2-aa83-c1a447687bb3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:21.523385 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3dc0c574-c3d7-4ad2-aa83-c1a447687bb3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:21.534362 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3dc0c574-c3d7-4ad2-aa83-c1a447687bb3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:21.536014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3dc0c574-c3d7-4ad2-aa83-c1a447687bb3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:21.537332 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3dc0c574-c3d7-4ad2-aa83-c1a447687bb3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.159453 Jun 14 19:47:21.537924 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 360/690] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:21 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:22.556328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-36f3c0a6-4fbb-4275-9893-71b597a1de10 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:22.556976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-36f3c0a6-4fbb-4275-9893-71b597a1de10 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:22.563531 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-36f3c0a6-4fbb-4275-9893-71b597a1de10 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:22.563915 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-36f3c0a6-4fbb-4275-9893-71b597a1de10 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:22.564676 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-36f3c0a6-4fbb-4275-9893-71b597a1de10 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:22.565107 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-36f3c0a6-4fbb-4275-9893-71b597a1de10 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:22.696349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-36f3c0a6-4fbb-4275-9893-71b597a1de10 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:22.704397 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-36f3c0a6-4fbb-4275-9893-71b597a1de10 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:22.705941 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-36f3c0a6-4fbb-4275-9893-71b597a1de10 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:22.707193 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-36f3c0a6-4fbb-4275-9893-71b597a1de10 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.155545 Jun 14 19:47:22.707808 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 331/691] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:22 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:23.724285 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-66f9d073-c325-49b1-aef8-748a5223e4c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:23.724902 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-66f9d073-c325-49b1-aef8-748a5223e4c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:23.732744 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-66f9d073-c325-49b1-aef8-748a5223e4c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:23.733197 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-66f9d073-c325-49b1-aef8-748a5223e4c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:23.733991 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-66f9d073-c325-49b1-aef8-748a5223e4c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:23.734426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-66f9d073-c325-49b1-aef8-748a5223e4c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:23.915758 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-66f9d073-c325-49b1-aef8-748a5223e4c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:23.923969 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-66f9d073-c325-49b1-aef8-748a5223e4c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:23.925490 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-66f9d073-c325-49b1-aef8-748a5223e4c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:23.926631 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-66f9d073-c325-49b1-aef8-748a5223e4c7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1746 microversion: 2.20 time: 0.206202 Jun 14 19:47:23.927469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 361/692] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:23 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1746 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:24.947383 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-944acbd4-ac27-4132-bda2-a64aec1d23fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:24.948061 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-944acbd4-ac27-4132-bda2-a64aec1d23fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:24.954841 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-944acbd4-ac27-4132-bda2-a64aec1d23fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:24.955311 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-944acbd4-ac27-4132-bda2-a64aec1d23fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:24.956078 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-944acbd4-ac27-4132-bda2-a64aec1d23fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:24.956515 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-944acbd4-ac27-4132-bda2-a64aec1d23fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:25.112625 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-944acbd4-ac27-4132-bda2-a64aec1d23fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:25.123512 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-944acbd4-ac27-4132-bda2-a64aec1d23fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:25.125280 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-944acbd4-ac27-4132-bda2-a64aec1d23fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:25.126641 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-944acbd4-ac27-4132-bda2-a64aec1d23fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1746 microversion: 2.20 time: 0.183750 Jun 14 19:47:25.127548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 332/693] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:24 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1746 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:26.145439 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-47dac612-5f4e-42ae-9d9e-7a032a6e05c8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:26.146734 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-47dac612-5f4e-42ae-9d9e-7a032a6e05c8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:26.154348 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-47dac612-5f4e-42ae-9d9e-7a032a6e05c8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:26.155000 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-47dac612-5f4e-42ae-9d9e-7a032a6e05c8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:26.155872 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-47dac612-5f4e-42ae-9d9e-7a032a6e05c8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:26.156263 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-47dac612-5f4e-42ae-9d9e-7a032a6e05c8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:26.314673 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-47dac612-5f4e-42ae-9d9e-7a032a6e05c8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:26.324024 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-47dac612-5f4e-42ae-9d9e-7a032a6e05c8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:26.325777 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-47dac612-5f4e-42ae-9d9e-7a032a6e05c8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:26.327408 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-47dac612-5f4e-42ae-9d9e-7a032a6e05c8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1741 microversion: 2.20 time: 0.185960 Jun 14 19:47:26.339553 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 362/694] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:26 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:27.039298 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-e073d40a-13fc-4ff8-ba98-295999fd5267 req-a70e5ab7-a704-44e9-a118-b201ebec2e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574d3163-12b7-4f68-9f90-445a0d1b0b8e", "name": "network-vif-plugged", "status": "completed", "tag": "367ce7c0-470d-4698-8a1e-52c8e78f7f64"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:27.048922 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-e073d40a-13fc-4ff8-ba98-295999fd5267 req-a70e5ab7-a704-44e9-a118-b201ebec2e25 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:27.049369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-e073d40a-13fc-4ff8-ba98-295999fd5267 req-a70e5ab7-a704-44e9-a118-b201ebec2e25 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:27.062108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-e073d40a-13fc-4ff8-ba98-295999fd5267 req-a70e5ab7-a704-44e9-a118-b201ebec2e25 service nova] Creating event network-vif-plugged:367ce7c0-470d-4698-8a1e-52c8e78f7f64 for instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e on hv-cinder-84580 Jun 14 19:47:27.068112 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-e073d40a-13fc-4ff8-ba98-295999fd5267 req-a70e5ab7-a704-44e9-a118-b201ebec2e25 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209938 Jun 14 19:47:27.068999 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 333/695] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:47:27.348432 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0cc992d3-1ac5-48e0-9e75-47a660a76438 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:27.349658 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-0cc992d3-1ac5-48e0-9e75-47a660a76438 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:27.357038 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0cc992d3-1ac5-48e0-9e75-47a660a76438 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:27.357728 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0cc992d3-1ac5-48e0-9e75-47a660a76438 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:27.358687 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0cc992d3-1ac5-48e0-9e75-47a660a76438 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:27.359286 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0cc992d3-1ac5-48e0-9e75-47a660a76438 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:27.497120 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0cc992d3-1ac5-48e0-9e75-47a660a76438 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:27.499562 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:27.506642 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0cc992d3-1ac5-48e0-9e75-47a660a76438 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:27.509127 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0cc992d3-1ac5-48e0-9e75-47a660a76438 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:27.510422 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-0cc992d3-1ac5-48e0-9e75-47a660a76438 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1741 microversion: 2.20 time: 0.168097 Jun 14 19:47:27.511071 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 363/696] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:27 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:28.529908 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-7b48710d-199c-4ec3-8ad5-9ab737d5e912 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:28.530747 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-7b48710d-199c-4ec3-8ad5-9ab737d5e912 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:28.538195 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7b48710d-199c-4ec3-8ad5-9ab737d5e912 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:28.538744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7b48710d-199c-4ec3-8ad5-9ab737d5e912 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:28.540202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7b48710d-199c-4ec3-8ad5-9ab737d5e912 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:28.540718 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7b48710d-199c-4ec3-8ad5-9ab737d5e912 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:28.564948 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=100 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:28.706344 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-7b48710d-199c-4ec3-8ad5-9ab737d5e912 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:28.716865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-7b48710d-199c-4ec3-8ad5-9ab737d5e912 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:28.718375 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-7b48710d-199c-4ec3-8ad5-9ab737d5e912 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:28.719701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-7b48710d-199c-4ec3-8ad5-9ab737d5e912 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1741 microversion: 2.20 time: 0.194275 Jun 14 19:47:28.720513 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 334/697] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:28 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:29.292822 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0543f24d-8cc1-4296-a5b1-4d94e2fe3f53 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:29.293427 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-0543f24d-8cc1-4296-a5b1-4d94e2fe3f53 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:29.301197 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0543f24d-8cc1-4296-a5b1-4d94e2fe3f53 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:29.301964 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0543f24d-8cc1-4296-a5b1-4d94e2fe3f53 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:29.302786 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0543f24d-8cc1-4296-a5b1-4d94e2fe3f53 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:29.303230 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0543f24d-8cc1-4296-a5b1-4d94e2fe3f53 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:29.329702 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.objects.instance [None req-0543f24d-8cc1-4296-a5b1-4d94e2fe3f53 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lazy-loading 'flavor' on Instance uuid 2a0421fa-7df8-4d48-b112-fff79061f5ae {{(pid=124068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:47:29.412234 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-0543f24d-8cc1-4296-a5b1-4d94e2fe3f53 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "POST /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae/action" status: 202 len: 0 microversion: 2.1 time: 0.124425 Jun 14 19:47:29.416738 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 364/698] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 14 19:47:29 2022] POST /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:47:29.422209 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-cd645e10-9228-4d60-bfc7-6f8cb91e9a3f tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:29.422824 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-cd645e10-9228-4d60-bfc7-6f8cb91e9a3f tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:29.424789 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:29.431047 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cd645e10-9228-4d60-bfc7-6f8cb91e9a3f tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:29.431838 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cd645e10-9228-4d60-bfc7-6f8cb91e9a3f tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:29.432984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cd645e10-9228-4d60-bfc7-6f8cb91e9a3f tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:29.435458 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cd645e10-9228-4d60-bfc7-6f8cb91e9a3f tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:29.595418 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-cd645e10-9228-4d60-bfc7-6f8cb91e9a3f tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:29.619605 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-cd645e10-9228-4d60-bfc7-6f8cb91e9a3f tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1570 microversion: 2.1 time: 0.201113 Jun 14 19:47:29.628085 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 335/699] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:29 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1570 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:29.744661 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-ac1f41c1-02d2-4e63-b8cd-f712d849531c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:29.745523 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-ac1f41c1-02d2-4e63-b8cd-f712d849531c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:29.752480 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ac1f41c1-02d2-4e63-b8cd-f712d849531c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:29.753008 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ac1f41c1-02d2-4e63-b8cd-f712d849531c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:29.753910 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ac1f41c1-02d2-4e63-b8cd-f712d849531c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:29.754416 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ac1f41c1-02d2-4e63-b8cd-f712d849531c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:29.922833 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ac1f41c1-02d2-4e63-b8cd-f712d849531c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:29.933283 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ac1f41c1-02d2-4e63-b8cd-f712d849531c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:29.935844 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ac1f41c1-02d2-4e63-b8cd-f712d849531c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:29.937759 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-ac1f41c1-02d2-4e63-b8cd-f712d849531c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1741 microversion: 2.20 time: 0.202569 Jun 14 19:47:29.938533 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 365/700] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:29 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:30.642649 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2abcdf9f-bdb5-41e9-b879-a2336c4e55a6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:30.643341 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2abcdf9f-bdb5-41e9-b879-a2336c4e55a6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:30.651141 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2abcdf9f-bdb5-41e9-b879-a2336c4e55a6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:30.651867 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2abcdf9f-bdb5-41e9-b879-a2336c4e55a6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:30.652710 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2abcdf9f-bdb5-41e9-b879-a2336c4e55a6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:30.653367 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2abcdf9f-bdb5-41e9-b879-a2336c4e55a6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:30.812637 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2abcdf9f-bdb5-41e9-b879-a2336c4e55a6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:30.826308 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2abcdf9f-bdb5-41e9-b879-a2336c4e55a6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1570 microversion: 2.1 time: 0.187308 Jun 14 19:47:30.827182 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 336/701] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:30 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1570 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:30.962308 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0190e4a9-ebe8-449b-985d-9d2a2844e3f8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:30.964585 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-0190e4a9-ebe8-449b-985d-9d2a2844e3f8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:30.972195 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0190e4a9-ebe8-449b-985d-9d2a2844e3f8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:30.973053 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0190e4a9-ebe8-449b-985d-9d2a2844e3f8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:30.974259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0190e4a9-ebe8-449b-985d-9d2a2844e3f8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:30.974918 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0190e4a9-ebe8-449b-985d-9d2a2844e3f8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:31.162505 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0190e4a9-ebe8-449b-985d-9d2a2844e3f8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:31.173263 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0190e4a9-ebe8-449b-985d-9d2a2844e3f8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:31.175202 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0190e4a9-ebe8-449b-985d-9d2a2844e3f8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:31.176944 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-0190e4a9-ebe8-449b-985d-9d2a2844e3f8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1741 microversion: 2.20 time: 0.223160 Jun 14 19:47:31.188675 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 366/702] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:30 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1741 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:31.843855 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-f7752dbe-4641-4948-95ce-e88a43ef8373 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:31.845049 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-f7752dbe-4641-4948-95ce-e88a43ef8373 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:31.851467 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f7752dbe-4641-4948-95ce-e88a43ef8373 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:31.852525 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f7752dbe-4641-4948-95ce-e88a43ef8373 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:31.853444 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f7752dbe-4641-4948-95ce-e88a43ef8373 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:31.853888 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f7752dbe-4641-4948-95ce-e88a43ef8373 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:31.991864 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-f7752dbe-4641-4948-95ce-e88a43ef8373 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:32.000171 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-f7752dbe-4641-4948-95ce-e88a43ef8373 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1570 microversion: 2.1 time: 0.160093 Jun 14 19:47:32.001010 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 337/703] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:31 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:32.197029 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-2ff1a8d9-ae9f-4917-9512-593e4a7ded0e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:32.198382 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-2ff1a8d9-ae9f-4917-9512-593e4a7ded0e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:32.206184 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2ff1a8d9-ae9f-4917-9512-593e4a7ded0e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:32.206661 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2ff1a8d9-ae9f-4917-9512-593e4a7ded0e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:32.207474 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2ff1a8d9-ae9f-4917-9512-593e4a7ded0e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:32.208053 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2ff1a8d9-ae9f-4917-9512-593e4a7ded0e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:32.350186 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-2ff1a8d9-ae9f-4917-9512-593e4a7ded0e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:32.359314 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-2ff1a8d9-ae9f-4917-9512-593e4a7ded0e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:32.361033 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-2ff1a8d9-ae9f-4917-9512-593e4a7ded0e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:32.362405 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-2ff1a8d9-ae9f-4917-9512-593e4a7ded0e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1741 microversion: 2.20 time: 0.170545 Jun 14 19:47:32.363266 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 367/704] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:32 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:33.016872 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-51e1076a-5448-454e-840d-b10ff41b9547 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:33.018093 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-51e1076a-5448-454e-840d-b10ff41b9547 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:33.025319 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-51e1076a-5448-454e-840d-b10ff41b9547 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:33.026362 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-51e1076a-5448-454e-840d-b10ff41b9547 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:33.027132 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-51e1076a-5448-454e-840d-b10ff41b9547 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:33.027740 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-51e1076a-5448-454e-840d-b10ff41b9547 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:33.205521 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-51e1076a-5448-454e-840d-b10ff41b9547 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:33.213873 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-51e1076a-5448-454e-840d-b10ff41b9547 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1570 microversion: 2.1 time: 0.200794 Jun 14 19:47:33.215201 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 338/705] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:33 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1570 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:33.381720 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-ec08025b-5995-4a82-aa12-8b9a0b250ca8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:33.383067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-ec08025b-5995-4a82-aa12-8b9a0b250ca8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:33.392631 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ec08025b-5995-4a82-aa12-8b9a0b250ca8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:33.393405 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ec08025b-5995-4a82-aa12-8b9a0b250ca8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:33.394585 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ec08025b-5995-4a82-aa12-8b9a0b250ca8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:33.395257 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ec08025b-5995-4a82-aa12-8b9a0b250ca8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:33.607880 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ec08025b-5995-4a82-aa12-8b9a0b250ca8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:33.616541 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ec08025b-5995-4a82-aa12-8b9a0b250ca8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:33.624207 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ec08025b-5995-4a82-aa12-8b9a0b250ca8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:33.625566 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-ec08025b-5995-4a82-aa12-8b9a0b250ca8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1741 microversion: 2.20 time: 0.247992 Jun 14 19:47:33.637509 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 368/706] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:33 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1741 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:34.231215 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c0ddf240-272c-412b-a31a-cb4443e28063 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:34.232049 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c0ddf240-272c-412b-a31a-cb4443e28063 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:34.239620 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0ddf240-272c-412b-a31a-cb4443e28063 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:34.240081 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0ddf240-272c-412b-a31a-cb4443e28063 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:34.240880 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0ddf240-272c-412b-a31a-cb4443e28063 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:34.241319 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0ddf240-272c-412b-a31a-cb4443e28063 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:34.458933 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c0ddf240-272c-412b-a31a-cb4443e28063 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:34.467763 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c0ddf240-272c-412b-a31a-cb4443e28063 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1570 microversion: 2.1 time: 0.240599 Jun 14 19:47:34.469474 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 339/707] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:34 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1570 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:34.644138 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0e1dff9d-7bc0-42ca-a912-3db658ca960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:34.645122 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-0e1dff9d-7bc0-42ca-a912-3db658ca960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:34.664820 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0e1dff9d-7bc0-42ca-a912-3db658ca960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:34.665332 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0e1dff9d-7bc0-42ca-a912-3db658ca960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:34.666336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0e1dff9d-7bc0-42ca-a912-3db658ca960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:34.666931 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0e1dff9d-7bc0-42ca-a912-3db658ca960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:34.839399 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0e1dff9d-7bc0-42ca-a912-3db658ca960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:34.847655 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0e1dff9d-7bc0-42ca-a912-3db658ca960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:34.849156 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0e1dff9d-7bc0-42ca-a912-3db658ca960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:34.850346 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-0e1dff9d-7bc0-42ca-a912-3db658ca960f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1741 microversion: 2.20 time: 0.210271 Jun 14 19:47:34.850907 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 369/708] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:34 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1741 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:35.486079 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-57a13445-1033-4d3c-ae20-66b34462f4f3 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:35.486685 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-57a13445-1033-4d3c-ae20-66b34462f4f3 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:35.493414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-57a13445-1033-4d3c-ae20-66b34462f4f3 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:35.494029 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-57a13445-1033-4d3c-ae20-66b34462f4f3 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:35.494793 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-57a13445-1033-4d3c-ae20-66b34462f4f3 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:35.495264 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-57a13445-1033-4d3c-ae20-66b34462f4f3 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:35.639314 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-57a13445-1033-4d3c-ae20-66b34462f4f3 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:35.647346 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-57a13445-1033-4d3c-ae20-66b34462f4f3 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1570 microversion: 2.1 time: 0.164885 Jun 14 19:47:35.647976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 340/709] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:35 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:35.871923 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-07c33603-3011-4e7a-aa92-aa1a84272887 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:35.872628 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-07c33603-3011-4e7a-aa92-aa1a84272887 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:35.882099 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-07c33603-3011-4e7a-aa92-aa1a84272887 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:35.882638 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-07c33603-3011-4e7a-aa92-aa1a84272887 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:35.884665 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-07c33603-3011-4e7a-aa92-aa1a84272887 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:35.885334 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-07c33603-3011-4e7a-aa92-aa1a84272887 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:36.064651 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-07c33603-3011-4e7a-aa92-aa1a84272887 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:36.074187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-07c33603-3011-4e7a-aa92-aa1a84272887 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:36.075765 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-07c33603-3011-4e7a-aa92-aa1a84272887 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:36.076973 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-07c33603-3011-4e7a-aa92-aa1a84272887 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1723 microversion: 2.20 time: 0.211440 Jun 14 19:47:36.077575 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 370/710] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:35 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:36.663922 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-fc4032dd-1103-4c82-9a78-dff1c2c0b8ea tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:36.665140 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-fc4032dd-1103-4c82-9a78-dff1c2c0b8ea tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:36.671533 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fc4032dd-1103-4c82-9a78-dff1c2c0b8ea tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:36.671976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fc4032dd-1103-4c82-9a78-dff1c2c0b8ea tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:36.672935 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fc4032dd-1103-4c82-9a78-dff1c2c0b8ea tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:36.673454 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fc4032dd-1103-4c82-9a78-dff1c2c0b8ea tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:36.810399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-fc4032dd-1103-4c82-9a78-dff1c2c0b8ea tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:36.818345 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-fc4032dd-1103-4c82-9a78-dff1c2c0b8ea tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1570 microversion: 2.1 time: 0.158162 Jun 14 19:47:36.818920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 341/711] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:36 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:37.095041 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-2bd44b1d-ad76-43e2-be93-56b1f0c83e6c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:37.095649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-2bd44b1d-ad76-43e2-be93-56b1f0c83e6c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:37.102861 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2bd44b1d-ad76-43e2-be93-56b1f0c83e6c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:37.103316 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2bd44b1d-ad76-43e2-be93-56b1f0c83e6c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:37.104101 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2bd44b1d-ad76-43e2-be93-56b1f0c83e6c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:37.104524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2bd44b1d-ad76-43e2-be93-56b1f0c83e6c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:37.304250 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-2bd44b1d-ad76-43e2-be93-56b1f0c83e6c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:37.312277 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-2bd44b1d-ad76-43e2-be93-56b1f0c83e6c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:37.313795 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-2bd44b1d-ad76-43e2-be93-56b1f0c83e6c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:37.314935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-2bd44b1d-ad76-43e2-be93-56b1f0c83e6c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1723 microversion: 2.20 time: 0.224002 Jun 14 19:47:37.315489 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 371/712] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:37 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:37.835589 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6b627d16-1bb4-454d-8136-d31ddfd5331b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:37.836942 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-6b627d16-1bb4-454d-8136-d31ddfd5331b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:37.843818 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6b627d16-1bb4-454d-8136-d31ddfd5331b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:37.844386 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6b627d16-1bb4-454d-8136-d31ddfd5331b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:37.845224 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6b627d16-1bb4-454d-8136-d31ddfd5331b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:37.845675 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6b627d16-1bb4-454d-8136-d31ddfd5331b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:38.003931 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-6b627d16-1bb4-454d-8136-d31ddfd5331b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:38.012300 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6b627d16-1bb4-454d-8136-d31ddfd5331b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1570 microversion: 2.1 time: 0.180901 Jun 14 19:47:38.013321 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 342/713] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:37 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:38.332022 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0f4d23dc-8971-42a2-bcd9-d488defd98e5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:38.332641 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-0f4d23dc-8971-42a2-bcd9-d488defd98e5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:38.339866 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0f4d23dc-8971-42a2-bcd9-d488defd98e5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:38.340264 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0f4d23dc-8971-42a2-bcd9-d488defd98e5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:38.341030 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0f4d23dc-8971-42a2-bcd9-d488defd98e5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:38.341502 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0f4d23dc-8971-42a2-bcd9-d488defd98e5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:38.475690 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0f4d23dc-8971-42a2-bcd9-d488defd98e5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:38.484849 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0f4d23dc-8971-42a2-bcd9-d488defd98e5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:38.486508 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0f4d23dc-8971-42a2-bcd9-d488defd98e5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:38.487653 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-0f4d23dc-8971-42a2-bcd9-d488defd98e5 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1726 microversion: 2.20 time: 0.159590 Jun 14 19:47:38.488206 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 372/714] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:38 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:38.506065 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-fb9df3fc-05cd-4bff-8c9e-006b0e5e22ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "402bc160-11db-4018-872d-52c8eda4b02c"}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:38.507207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-fb9df3fc-05cd-4bff-8c9e-006b0e5e22ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:38.515386 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fb9df3fc-05cd-4bff-8c9e-006b0e5e22ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:38.515831 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fb9df3fc-05cd-4bff-8c9e-006b0e5e22ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:38.516591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fb9df3fc-05cd-4bff-8c9e-006b0e5e22ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:38.517571 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fb9df3fc-05cd-4bff-8c9e-006b0e5e22ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:38.782859 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-fb9df3fc-05cd-4bff-8c9e-006b0e5e22ea tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "POST /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.281139 Jun 14 19:47:38.783482 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 343/715] 10.222.0.44 () {62 vars in 1363 bytes} [Tue Jun 14 19:47:38 2022] POST /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e/os-volume_attachments => generated 188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 19:47:38.903096 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-dfe17efe-b929-4017-9b4c-5ed1e5951619 req-ce728d6f-5822-48a0-924b-7055ea384970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574d3163-12b7-4f68-9f90-445a0d1b0b8e", "name": "network-vif-unplugged", "status": "completed", "tag": "367ce7c0-470d-4698-8a1e-52c8e78f7f64"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:38.912243 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-dfe17efe-b929-4017-9b4c-5ed1e5951619 req-ce728d6f-5822-48a0-924b-7055ea384970 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:38.912909 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-dfe17efe-b929-4017-9b4c-5ed1e5951619 req-ce728d6f-5822-48a0-924b-7055ea384970 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:38.921692 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-92db6e99-c0f5-4024-b8c7-c80588ea6072 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:38.922220 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-92db6e99-c0f5-4024-b8c7-c80588ea6072 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:38.926731 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.compute.server_external_events [req-dfe17efe-b929-4017-9b4c-5ed1e5951619 req-ce728d6f-5822-48a0-924b-7055ea384970 service nova] Unable to find a host for instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e. Dropping event network-vif-unplugged {{(pid=124068) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 14 19:47:38.927620 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-dfe17efe-b929-4017-9b4c-5ed1e5951619 req-ce728d6f-5822-48a0-924b-7055ea384970 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031593 Jun 14 19:47:38.928201 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 373/716] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 14 19:47:38.928333 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-92db6e99-c0f5-4024-b8c7-c80588ea6072 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:38.928684 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-92db6e99-c0f5-4024-b8c7-c80588ea6072 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:38.930264 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-92db6e99-c0f5-4024-b8c7-c80588ea6072 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:38.930777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-92db6e99-c0f5-4024-b8c7-c80588ea6072 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:39.030205 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-db08a7aa-c3a9-4fa3-8396-b642e6b89d15 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:39.030823 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-db08a7aa-c3a9-4fa3-8396-b642e6b89d15 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:39.037425 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-db08a7aa-c3a9-4fa3-8396-b642e6b89d15 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:39.038375 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-db08a7aa-c3a9-4fa3-8396-b642e6b89d15 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:39.049822 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-db08a7aa-c3a9-4fa3-8396-b642e6b89d15 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:39.050382 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-db08a7aa-c3a9-4fa3-8396-b642e6b89d15 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:39.168943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-92db6e99-c0f5-4024-b8c7-c80588ea6072 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "DELETE /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e/os-volume_attachments/402bc160-11db-4018-872d-52c8eda4b02c" status: 202 len: 0 microversion: 2.20 time: 0.251089 Jun 14 19:47:39.169555 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 344/717] 10.222.0.44 () {60 vars in 1456 bytes} [Tue Jun 14 19:47:38 2022] DELETE /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e/os-volume_attachments/402bc160-11db-4018-872d-52c8eda4b02c => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 14 19:47:39.174560 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1184476837", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "networks": [{"uuid": "e6d03972-7a1d-4299-9c92-43b099faaa8b"}]}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:39.198055 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-db08a7aa-c3a9-4fa3-8396-b642e6b89d15 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:39.205554 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-db08a7aa-c3a9-4fa3-8396-b642e6b89d15 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1570 microversion: 2.1 time: 0.179079 Jun 14 19:47:39.206124 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 374/718] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:39 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:39.233314 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.network.neutron [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] validate_networks() for [('e6d03972-7a1d-4299-9c92-43b099faaa8b', None, None, None, None, None)] {{(pid=124069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:47:39.235123 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e4f9a4cf-610b-43ff-8eba-22da53ba2bde tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:39.235688 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e4f9a4cf-610b-43ff-8eba-22da53ba2bde tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:39.241781 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e4f9a4cf-610b-43ff-8eba-22da53ba2bde tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:39.242302 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e4f9a4cf-610b-43ff-8eba-22da53ba2bde tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:39.243065 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e4f9a4cf-610b-43ff-8eba-22da53ba2bde tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:39.243494 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e4f9a4cf-610b-43ff-8eba-22da53ba2bde tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:39.319683 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e4f9a4cf-610b-43ff-8eba-22da53ba2bde tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "POST /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e/action" status: 202 len: 0 microversion: 2.20 time: 0.088305 Jun 14 19:47:39.321628 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 375/719] 10.222.0.44 () {62 vars in 1318 bytes} [Tue Jun 14 19:47:39 2022] POST /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 14 19:47:39.329952 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-38fb2da2-e806-44d4-8a87-0bbb3c9c21ec tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:39.331634 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-38fb2da2-e806-44d4-8a87-0bbb3c9c21ec tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:39.339123 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-38fb2da2-e806-44d4-8a87-0bbb3c9c21ec tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:39.339769 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-38fb2da2-e806-44d4-8a87-0bbb3c9c21ec tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:39.340350 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-38fb2da2-e806-44d4-8a87-0bbb3c9c21ec tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:39.340789 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-38fb2da2-e806-44d4-8a87-0bbb3c9c21ec tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:39.552325 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-38fb2da2-e806-44d4-8a87-0bbb3c9c21ec tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:39.563220 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-38fb2da2-e806-44d4-8a87-0bbb3c9c21ec tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:39.564700 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-38fb2da2-e806-44d4-8a87-0bbb3c9c21ec tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:39.566110 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-38fb2da2-e806-44d4-8a87-0bbb3c9c21ec tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1674 microversion: 2.20 time: 0.240433 Jun 14 19:47:39.566829 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 376/720] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:39 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1674 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:47:39.662231 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Flavor limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:47:39.662781 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Image limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:47:39.663625 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Flavor pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:47:39.664076 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Image pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:47:39.664558 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:47:39.675285 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:39.675947 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:39.677238 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:39.678002 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:39.698012 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Getting quotas for project 35a27fefe9ec41c09c01d67ec3d75683. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:47:39.702060 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Getting quotas for user 2900dfb691734898a5fd1ac12207cebf and project 35a27fefe9ec41c09c01d67ec3d75683. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:47:39.714908 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Going to run 1 instances... {{(pid=124069) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:47:39.717186 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:47:39.774776 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-ea934e9c-8af0-4c6c-b07f-2e375133da0d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603981 Jun 14 19:47:39.775949 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 345/721] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:47:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:47:39.792534 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d6615524-d908-412e-964a-dc5e2a5e060d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:39.793236 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d6615524-d908-412e-964a-dc5e2a5e060d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:39.869137 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d6615524-d908-412e-964a-dc5e2a5e060d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:39.879331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d6615524-d908-412e-964a-dc5e2a5e060d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1219 microversion: 2.1 time: 0.096520 Jun 14 19:47:39.880637 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 346/722] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:39 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:47:40.006065 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-6cb4d02a-f377-4419-981a-2da098410338 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:40.006882 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-6cb4d02a-f377-4419-981a-2da098410338 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:40.009634 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:40.015316 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6cb4d02a-f377-4419-981a-2da098410338 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:40.016073 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6cb4d02a-f377-4419-981a-2da098410338 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:40.017085 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6cb4d02a-f377-4419-981a-2da098410338 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:40.017757 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6cb4d02a-f377-4419-981a-2da098410338 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:40.050084 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-6cb4d02a-f377-4419-981a-2da098410338 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/ips" status: 200 len: 148 microversion: 2.1 time: 0.337452 Jun 14 19:47:40.053424 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 377/723] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 14 19:47:39 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/ips => generated 148 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:40.224291 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-81d8919a-7c3a-4c7e-bbb0-bcf20d4ea336 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:40.225311 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-81d8919a-7c3a-4c7e-bbb0-bcf20d4ea336 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:40.239769 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-81d8919a-7c3a-4c7e-bbb0-bcf20d4ea336 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:40.240279 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-81d8919a-7c3a-4c7e-bbb0-bcf20d4ea336 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:40.241089 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-81d8919a-7c3a-4c7e-bbb0-bcf20d4ea336 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:40.241577 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-81d8919a-7c3a-4c7e-bbb0-bcf20d4ea336 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:40.279563 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:40.465830 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-81d8919a-7c3a-4c7e-bbb0-bcf20d4ea336 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:40.473571 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-81d8919a-7c3a-4c7e-bbb0-bcf20d4ea336 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1570 microversion: 2.1 time: 0.254352 Jun 14 19:47:40.474137 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 347/724] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:40 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1570 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:40.586402 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-250e3ac6-6f71-4f9e-8dce-7709332d2dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:40.587188 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-250e3ac6-6f71-4f9e-8dce-7709332d2dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:40.594658 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-250e3ac6-6f71-4f9e-8dce-7709332d2dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:40.595118 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-250e3ac6-6f71-4f9e-8dce-7709332d2dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:40.595888 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-250e3ac6-6f71-4f9e-8dce-7709332d2dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:40.596422 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-250e3ac6-6f71-4f9e-8dce-7709332d2dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:40.613776 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:40.897063 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-94b3d4ea-1b64-4571-8efd-fc5d5fc1afc6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:40.897809 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-94b3d4ea-1b64-4571-8efd-fc5d5fc1afc6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:40.904875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-94b3d4ea-1b64-4571-8efd-fc5d5fc1afc6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:40.905323 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-94b3d4ea-1b64-4571-8efd-fc5d5fc1afc6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:40.906122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-94b3d4ea-1b64-4571-8efd-fc5d5fc1afc6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:40.906552 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-94b3d4ea-1b64-4571-8efd-fc5d5fc1afc6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:40.968604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-94b3d4ea-1b64-4571-8efd-fc5d5fc1afc6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:40.976729 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-94b3d4ea-1b64-4571-8efd-fc5d5fc1afc6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1215 microversion: 2.1 time: 0.082974 Jun 14 19:47:40.977347 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 348/725] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:40 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:47:40.981474 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-250e3ac6-6f71-4f9e-8dce-7709332d2dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:40.993814 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-250e3ac6-6f71-4f9e-8dce-7709332d2dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:40.995301 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-250e3ac6-6f71-4f9e-8dce-7709332d2dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:40.996566 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-250e3ac6-6f71-4f9e-8dce-7709332d2dcf tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.415368 Jun 14 19:47:40.997159 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 378/726] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:40 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:41.484560 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4ab7bce7-d98e-42ef-a1f6-2d2359888135 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a41955ab-007b-4b2d-baef-46ddd19ce603"}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:41.486491 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4ab7bce7-d98e-42ef-a1f6-2d2359888135 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:41.490254 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-84d76c00-f830-4c25-89f2-3e18034e1b88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:41.490871 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-84d76c00-f830-4c25-89f2-3e18034e1b88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:41.495676 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4ab7bce7-d98e-42ef-a1f6-2d2359888135 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:41.496433 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4ab7bce7-d98e-42ef-a1f6-2d2359888135 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:41.496674 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-84d76c00-f830-4c25-89f2-3e18034e1b88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:41.497108 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-84d76c00-f830-4c25-89f2-3e18034e1b88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:41.497728 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4ab7bce7-d98e-42ef-a1f6-2d2359888135 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:41.497922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-84d76c00-f830-4c25-89f2-3e18034e1b88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:41.498360 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-84d76c00-f830-4c25-89f2-3e18034e1b88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:41.498482 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4ab7bce7-d98e-42ef-a1f6-2d2359888135 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:41.644571 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-84d76c00-f830-4c25-89f2-3e18034e1b88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:41.653202 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-84d76c00-f830-4c25-89f2-3e18034e1b88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1570 microversion: 2.1 time: 0.166660 Jun 14 19:47:41.654044 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 379/727] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:41 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:47:41.997301 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-7159545d-4730-4b6a-9124-dbbb38668c1d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:41.997969 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-7159545d-4730-4b6a-9124-dbbb38668c1d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:42.004765 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7159545d-4730-4b6a-9124-dbbb38668c1d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:42.005507 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7159545d-4730-4b6a-9124-dbbb38668c1d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:42.006463 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7159545d-4730-4b6a-9124-dbbb38668c1d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:42.006983 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7159545d-4730-4b6a-9124-dbbb38668c1d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:42.078572 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-7159545d-4730-4b6a-9124-dbbb38668c1d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:42.082708 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4ab7bce7-d98e-42ef-a1f6-2d2359888135 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "POST /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.602037 Jun 14 19:47:42.082876 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 349/728] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 14 19:47:41 2022] POST /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments => generated 194 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:42.087901 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-bad5e1fd-77eb-431e-aa1e-45a0d4450b60 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:42.088593 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-bad5e1fd-77eb-431e-aa1e-45a0d4450b60 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:42.090869 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-7159545d-4730-4b6a-9124-dbbb38668c1d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1271 microversion: 2.1 time: 0.100958 Jun 14 19:47:42.093420 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 380/729] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:41 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:47:42.095438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bad5e1fd-77eb-431e-aa1e-45a0d4450b60 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:42.095878 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bad5e1fd-77eb-431e-aa1e-45a0d4450b60 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:42.096633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bad5e1fd-77eb-431e-aa1e-45a0d4450b60 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:42.097061 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-bad5e1fd-77eb-431e-aa1e-45a0d4450b60 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:42.257089 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-bad5e1fd-77eb-431e-aa1e-45a0d4450b60 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:42.265150 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-bad5e1fd-77eb-431e-aa1e-45a0d4450b60 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:42.266729 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-bad5e1fd-77eb-431e-aa1e-45a0d4450b60 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:42.267880 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-bad5e1fd-77eb-431e-aa1e-45a0d4450b60 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.184067 Jun 14 19:47:42.268433 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 350/730] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:42 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:42.671688 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c11488ad-3092-42ed-a99f-18ff8d2683bd tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:42.672390 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c11488ad-3092-42ed-a99f-18ff8d2683bd tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:42.689732 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c11488ad-3092-42ed-a99f-18ff8d2683bd tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:42.690336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c11488ad-3092-42ed-a99f-18ff8d2683bd tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:42.691168 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c11488ad-3092-42ed-a99f-18ff8d2683bd tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:42.691822 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c11488ad-3092-42ed-a99f-18ff8d2683bd tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:42.946725 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c11488ad-3092-42ed-a99f-18ff8d2683bd tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:42.974816 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c11488ad-3092-42ed-a99f-18ff8d2683bd tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1570 microversion: 2.1 time: 0.307490 Jun 14 19:47:42.982745 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 381/731] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:42 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1570 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:43.107201 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4ffd7815-d54d-450a-91ee-2304753f3960 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:43.107988 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4ffd7815-d54d-450a-91ee-2304753f3960 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:43.114476 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4ffd7815-d54d-450a-91ee-2304753f3960 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:43.115017 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4ffd7815-d54d-450a-91ee-2304753f3960 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:43.115814 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4ffd7815-d54d-450a-91ee-2304753f3960 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:43.116246 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4ffd7815-d54d-450a-91ee-2304753f3960 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:43.195646 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4ffd7815-d54d-450a-91ee-2304753f3960 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:43.206632 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4ffd7815-d54d-450a-91ee-2304753f3960 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1277 microversion: 2.1 time: 0.103052 Jun 14 19:47:43.207207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 351/732] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:43 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:43.286598 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d4163ef9-7ac6-4aca-bf9c-4ebe649dfd1c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:43.287122 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d4163ef9-7ac6-4aca-bf9c-4ebe649dfd1c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:43.293497 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d4163ef9-7ac6-4aca-bf9c-4ebe649dfd1c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:43.293942 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d4163ef9-7ac6-4aca-bf9c-4ebe649dfd1c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:43.294648 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d4163ef9-7ac6-4aca-bf9c-4ebe649dfd1c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:43.295313 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d4163ef9-7ac6-4aca-bf9c-4ebe649dfd1c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:43.541717 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d4163ef9-7ac6-4aca-bf9c-4ebe649dfd1c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:43.549966 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d4163ef9-7ac6-4aca-bf9c-4ebe649dfd1c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:43.551835 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d4163ef9-7ac6-4aca-bf9c-4ebe649dfd1c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:43.552989 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d4163ef9-7ac6-4aca-bf9c-4ebe649dfd1c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.270424 Jun 14 19:47:43.553572 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 382/733] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:43 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:47:43.998367 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-3760970c-aecd-4788-98a0-c892bf1ab6f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:43.999288 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-3760970c-aecd-4788-98a0-c892bf1ab6f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:44.010884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3760970c-aecd-4788-98a0-c892bf1ab6f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:44.020030 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3760970c-aecd-4788-98a0-c892bf1ab6f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:44.027398 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3760970c-aecd-4788-98a0-c892bf1ab6f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:44.028054 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3760970c-aecd-4788-98a0-c892bf1ab6f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:44.184879 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-3760970c-aecd-4788-98a0-c892bf1ab6f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:44.193165 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-3760970c-aecd-4788-98a0-c892bf1ab6f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1511 microversion: 2.1 time: 0.198946 Jun 14 19:47:44.197422 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 352/734] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:43 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1511 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:44.224180 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-75112e06-3820-46f8-b45b-24b59735a6b3 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:44.224624 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-08aba3a8-8622-4d5c-aff3-3ad4d5f1fc29 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:44.224948 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-08aba3a8-8622-4d5c-aff3-3ad4d5f1fc29 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:44.227783 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-75112e06-3820-46f8-b45b-24b59735a6b3 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:44.233833 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-08aba3a8-8622-4d5c-aff3-3ad4d5f1fc29 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:44.234648 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-08aba3a8-8622-4d5c-aff3-3ad4d5f1fc29 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:44.236262 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-75112e06-3820-46f8-b45b-24b59735a6b3 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:44.236808 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-08aba3a8-8622-4d5c-aff3-3ad4d5f1fc29 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:44.237099 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-75112e06-3820-46f8-b45b-24b59735a6b3 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:44.237358 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-08aba3a8-8622-4d5c-aff3-3ad4d5f1fc29 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:44.238330 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-75112e06-3820-46f8-b45b-24b59735a6b3 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:44.239065 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-75112e06-3820-46f8-b45b-24b59735a6b3 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:44.388010 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-75112e06-3820-46f8-b45b-24b59735a6b3 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "POST /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae/action" status: 202 len: 0 microversion: 2.1 time: 0.178795 Jun 14 19:47:44.389917 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 383/735] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 14 19:47:44 2022] POST /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:47:44.485955 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-84715b36-4619-4b7e-a468-b5e9b15c3734 req-3962145c-83b9-46ec-b572-81b9e007a3dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d5b449e-0612-4e56-963b-5841afefea1c", "tag": "94c03a74-6929-4077-a3f8-7be44d15be23"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:44.496777 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-84715b36-4619-4b7e-a468-b5e9b15c3734 req-3962145c-83b9-46ec-b572-81b9e007a3dc service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:44.497418 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-84715b36-4619-4b7e-a468-b5e9b15c3734 req-3962145c-83b9-46ec-b572-81b9e007a3dc service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:44.524169 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-84715b36-4619-4b7e-a468-b5e9b15c3734 req-3962145c-83b9-46ec-b572-81b9e007a3dc service nova] Creating event network-changed:94c03a74-6929-4077-a3f8-7be44d15be23 for instance 5d5b449e-0612-4e56-963b-5841afefea1c on hv-cinder-84580 Jun 14 19:47:44.544122 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-84715b36-4619-4b7e-a468-b5e9b15c3734 req-3962145c-83b9-46ec-b572-81b9e007a3dc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145002 Jun 14 19:47:44.548857 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 384/736] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:44.555427 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d66c4d20-92c0-4cd0-9855-7c67b64e470c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:44.556226 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d66c4d20-92c0-4cd0-9855-7c67b64e470c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:44.565074 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d66c4d20-92c0-4cd0-9855-7c67b64e470c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:44.565074 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d66c4d20-92c0-4cd0-9855-7c67b64e470c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:44.565074 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d66c4d20-92c0-4cd0-9855-7c67b64e470c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:44.567596 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d66c4d20-92c0-4cd0-9855-7c67b64e470c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:44.753997 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-08aba3a8-8622-4d5c-aff3-3ad4d5f1fc29 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:44.772523 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-08aba3a8-8622-4d5c-aff3-3ad4d5f1fc29 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1319 microversion: 2.1 time: 0.548850 Jun 14 19:47:44.774612 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 353/737] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:44 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1319 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:47:44.796003 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d66c4d20-92c0-4cd0-9855-7c67b64e470c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:44.804019 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d66c4d20-92c0-4cd0-9855-7c67b64e470c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1519 microversion: 2.1 time: 0.253719 Jun 14 19:47:44.804847 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-11427dab-da3a-4da7-a874-96e3d6b1ba2b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:44.808514 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-11427dab-da3a-4da7-a874-96e3d6b1ba2b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:44.810702 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 385/738] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:44 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1519 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:44.824643 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-11427dab-da3a-4da7-a874-96e3d6b1ba2b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:44.825365 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-11427dab-da3a-4da7-a874-96e3d6b1ba2b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:44.831905 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-11427dab-da3a-4da7-a874-96e3d6b1ba2b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:44.832526 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-11427dab-da3a-4da7-a874-96e3d6b1ba2b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:44.942230 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-c06376f4-4d4b-439f-842a-6d9656436b05 req-5a5ea614-53e9-4232-9568-cb0c2df07a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0421fa-7df8-4d48-b112-fff79061f5ae", "name": "network-vif-unplugged", "status": "completed", "tag": "04d8f989-9542-404e-a49a-add222e0ca49"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:44.953625 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-c06376f4-4d4b-439f-842a-6d9656436b05 req-5a5ea614-53e9-4232-9568-cb0c2df07a1d service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:44.954166 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-c06376f4-4d4b-439f-842a-6d9656436b05 req-5a5ea614-53e9-4232-9568-cb0c2df07a1d service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:44.975810 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.compute.server_external_events [req-c06376f4-4d4b-439f-842a-6d9656436b05 req-5a5ea614-53e9-4232-9568-cb0c2df07a1d service nova] Unable to find a host for instance 2a0421fa-7df8-4d48-b112-fff79061f5ae. Dropping event network-vif-unplugged {{(pid=124068) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 14 19:47:44.977019 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-c06376f4-4d4b-439f-842a-6d9656436b05 req-5a5ea614-53e9-4232-9568-cb0c2df07a1d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038353 Jun 14 19:47:44.977958 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 386/739] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 14 19:47:45.076354 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-11427dab-da3a-4da7-a874-96e3d6b1ba2b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:45.085306 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-11427dab-da3a-4da7-a874-96e3d6b1ba2b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:45.088134 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-11427dab-da3a-4da7-a874-96e3d6b1ba2b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:45.089522 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-11427dab-da3a-4da7-a874-96e3d6b1ba2b tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.313822 Jun 14 19:47:45.090185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 354/740] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:44 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:45.791105 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4697c34c-6285-48ba-95f0-2cfab7a8a438 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:45.792432 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4697c34c-6285-48ba-95f0-2cfab7a8a438 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:45.799188 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4697c34c-6285-48ba-95f0-2cfab7a8a438 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:45.799641 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4697c34c-6285-48ba-95f0-2cfab7a8a438 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:45.800411 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4697c34c-6285-48ba-95f0-2cfab7a8a438 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:45.800845 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4697c34c-6285-48ba-95f0-2cfab7a8a438 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:45.827317 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-53f755d9-2127-482d-801d-2fb2c3124879 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:45.828028 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-53f755d9-2127-482d-801d-2fb2c3124879 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:45.834294 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-53f755d9-2127-482d-801d-2fb2c3124879 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:45.834742 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-53f755d9-2127-482d-801d-2fb2c3124879 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:45.836564 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-53f755d9-2127-482d-801d-2fb2c3124879 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:45.837001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-53f755d9-2127-482d-801d-2fb2c3124879 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:45.947471 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4697c34c-6285-48ba-95f0-2cfab7a8a438 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:45.962116 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4697c34c-6285-48ba-95f0-2cfab7a8a438 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1319 microversion: 2.1 time: 0.175109 Jun 14 19:47:45.962982 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 387/741] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:45 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:46.005779 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-53f755d9-2127-482d-801d-2fb2c3124879 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:46.016059 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-53f755d9-2127-482d-801d-2fb2c3124879 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1519 microversion: 2.1 time: 0.192369 Jun 14 19:47:46.029141 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 355/742] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:45 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:46.107679 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3c2e90f3-e319-4863-a9f6-42acd4f2d6f4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:46.108283 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3c2e90f3-e319-4863-a9f6-42acd4f2d6f4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:46.114283 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3c2e90f3-e319-4863-a9f6-42acd4f2d6f4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:46.114742 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3c2e90f3-e319-4863-a9f6-42acd4f2d6f4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:46.115504 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3c2e90f3-e319-4863-a9f6-42acd4f2d6f4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:46.115937 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3c2e90f3-e319-4863-a9f6-42acd4f2d6f4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:46.263657 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3c2e90f3-e319-4863-a9f6-42acd4f2d6f4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:46.274359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3c2e90f3-e319-4863-a9f6-42acd4f2d6f4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:46.275864 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3c2e90f3-e319-4863-a9f6-42acd4f2d6f4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:46.277070 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3c2e90f3-e319-4863-a9f6-42acd4f2d6f4 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.173303 Jun 14 19:47:46.277646 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 388/743] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:46 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:46.979006 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1cd7dde1-13cf-445d-b5e0-d05bdd0952ad tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:46.979725 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-1cd7dde1-13cf-445d-b5e0-d05bdd0952ad tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:46.985966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1cd7dde1-13cf-445d-b5e0-d05bdd0952ad tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:46.986403 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1cd7dde1-13cf-445d-b5e0-d05bdd0952ad tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:46.987254 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1cd7dde1-13cf-445d-b5e0-d05bdd0952ad tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:46.987704 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1cd7dde1-13cf-445d-b5e0-d05bdd0952ad tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:47.036174 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-71a668e2-54a1-4870-a76d-d2e7fc24baaf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:47.037528 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-71a668e2-54a1-4870-a76d-d2e7fc24baaf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:47.044738 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-71a668e2-54a1-4870-a76d-d2e7fc24baaf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:47.045187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-71a668e2-54a1-4870-a76d-d2e7fc24baaf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:47.045991 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-71a668e2-54a1-4870-a76d-d2e7fc24baaf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:47.046425 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-71a668e2-54a1-4870-a76d-d2e7fc24baaf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:47.126680 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-1cd7dde1-13cf-445d-b5e0-d05bdd0952ad tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:47.134473 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-1cd7dde1-13cf-445d-b5e0-d05bdd0952ad tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1319 microversion: 2.1 time: 0.159907 Jun 14 19:47:47.135042 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 356/744] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:46 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:47.200105 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-71a668e2-54a1-4870-a76d-d2e7fc24baaf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:47.207586 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-71a668e2-54a1-4870-a76d-d2e7fc24baaf tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1519 microversion: 2.1 time: 0.175241 Jun 14 19:47:47.208176 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 389/745] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:47 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:47.295082 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-513f62a2-b6fa-471f-ba4f-250cb20909b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:47.295875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-513f62a2-b6fa-471f-ba4f-250cb20909b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:47.303671 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-513f62a2-b6fa-471f-ba4f-250cb20909b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:47.304455 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-513f62a2-b6fa-471f-ba4f-250cb20909b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:47.305696 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-513f62a2-b6fa-471f-ba4f-250cb20909b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:47.306501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-513f62a2-b6fa-471f-ba4f-250cb20909b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:47.449393 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-513f62a2-b6fa-471f-ba4f-250cb20909b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:47.461508 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-513f62a2-b6fa-471f-ba4f-250cb20909b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:47.463434 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-513f62a2-b6fa-471f-ba4f-250cb20909b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:47.465663 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-513f62a2-b6fa-471f-ba4f-250cb20909b0 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.174043 Jun 14 19:47:47.466713 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 357/746] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:47 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:47.596673 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-12c9281c-660c-43bd-b8e5-d8b4a5f671f1 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:47.597165 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-12c9281c-660c-43bd-b8e5-d8b4a5f671f1 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:47.603855 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-12c9281c-660c-43bd-b8e5-d8b4a5f671f1 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:47.604505 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-12c9281c-660c-43bd-b8e5-d8b4a5f671f1 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:47.605444 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-12c9281c-660c-43bd-b8e5-d8b4a5f671f1 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:47.606062 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-12c9281c-660c-43bd-b8e5-d8b4a5f671f1 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:47.630331 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-12c9281c-660c-43bd-b8e5-d8b4a5f671f1 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/ips" status: 200 len: 147 microversion: 2.1 time: 0.152929 Jun 14 19:47:47.630890 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 390/747] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 14 19:47:47 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/ips => generated 147 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:48.152149 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a7d9be22-68ac-4a33-995c-1ce47e6cee78 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:48.152752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a7d9be22-68ac-4a33-995c-1ce47e6cee78 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:48.159227 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a7d9be22-68ac-4a33-995c-1ce47e6cee78 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:48.159672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a7d9be22-68ac-4a33-995c-1ce47e6cee78 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:48.160426 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a7d9be22-68ac-4a33-995c-1ce47e6cee78 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:48.160856 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a7d9be22-68ac-4a33-995c-1ce47e6cee78 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:48.225364 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0ac31d31-bb0f-4079-80ba-1bc00249d14d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:48.226316 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-0ac31d31-bb0f-4079-80ba-1bc00249d14d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:48.233105 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0ac31d31-bb0f-4079-80ba-1bc00249d14d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:48.233604 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0ac31d31-bb0f-4079-80ba-1bc00249d14d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:48.234363 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0ac31d31-bb0f-4079-80ba-1bc00249d14d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:48.234828 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0ac31d31-bb0f-4079-80ba-1bc00249d14d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:48.317096 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a7d9be22-68ac-4a33-995c-1ce47e6cee78 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:48.329994 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a7d9be22-68ac-4a33-995c-1ce47e6cee78 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1319 microversion: 2.1 time: 0.182547 Jun 14 19:47:48.330583 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 358/748] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:48 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:48.387943 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0ac31d31-bb0f-4079-80ba-1bc00249d14d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:48.395496 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-0ac31d31-bb0f-4079-80ba-1bc00249d14d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1519 microversion: 2.1 time: 0.173974 Jun 14 19:47:48.396071 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 391/749] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:48 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:48.484502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4f4a06cb-35e9-4863-9f5d-e174d895ef65 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:48.485284 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4f4a06cb-35e9-4863-9f5d-e174d895ef65 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:48.492208 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4f4a06cb-35e9-4863-9f5d-e174d895ef65 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:48.492924 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4f4a06cb-35e9-4863-9f5d-e174d895ef65 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:48.493727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4f4a06cb-35e9-4863-9f5d-e174d895ef65 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:48.494168 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4f4a06cb-35e9-4863-9f5d-e174d895ef65 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:48.642270 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4f4a06cb-35e9-4863-9f5d-e174d895ef65 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:48.651881 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4f4a06cb-35e9-4863-9f5d-e174d895ef65 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:48.653683 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4f4a06cb-35e9-4863-9f5d-e174d895ef65 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:48.655161 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4f4a06cb-35e9-4863-9f5d-e174d895ef65 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.174843 Jun 14 19:47:48.655883 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 359/750] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:48 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:49.001247 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-8e3a6191-5419-425d-b818-2ea17165003e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "add3b722-89f0-4233-b393-d8791eb0ae10"}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:49.002731 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8e3a6191-5419-425d-b818-2ea17165003e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:49.009554 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8e3a6191-5419-425d-b818-2ea17165003e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:49.010002 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8e3a6191-5419-425d-b818-2ea17165003e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:49.010771 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8e3a6191-5419-425d-b818-2ea17165003e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:49.011198 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8e3a6191-5419-425d-b818-2ea17165003e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:49.347675 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-e74a622c-25de-464c-9bdd-f124772e2df9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:49.349023 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-e74a622c-25de-464c-9bdd-f124772e2df9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:49.356856 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e74a622c-25de-464c-9bdd-f124772e2df9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:49.357407 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e74a622c-25de-464c-9bdd-f124772e2df9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:49.358255 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e74a622c-25de-464c-9bdd-f124772e2df9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:49.358766 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e74a622c-25de-464c-9bdd-f124772e2df9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:49.499637 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e74a622c-25de-464c-9bdd-f124772e2df9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:49.507581 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-e74a622c-25de-464c-9bdd-f124772e2df9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1319 microversion: 2.1 time: 0.163121 Jun 14 19:47:49.508148 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 360/751] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:49 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:47:49.512492 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4a8c9d54-f904-4aaf-9a36-8b57786790b0 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:49.513093 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4a8c9d54-f904-4aaf-9a36-8b57786790b0 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:49.518749 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4a8c9d54-f904-4aaf-9a36-8b57786790b0 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:49.519196 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4a8c9d54-f904-4aaf-9a36-8b57786790b0 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:49.519948 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4a8c9d54-f904-4aaf-9a36-8b57786790b0 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:49.520386 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4a8c9d54-f904-4aaf-9a36-8b57786790b0 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:49.683307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4a8c9d54-f904-4aaf-9a36-8b57786790b0 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:49.707206 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:49.710958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4a8c9d54-f904-4aaf-9a36-8b57786790b0 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1519 microversion: 2.1 time: 0.201123 Jun 14 19:47:49.711652 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 361/752] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:49 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:49.720053 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2fedfad3-7515-4e73-8fc7-a846efbbb5d6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:49.720053 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2fedfad3-7515-4e73-8fc7-a846efbbb5d6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:49.725103 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2fedfad3-7515-4e73-8fc7-a846efbbb5d6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:49.725897 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2fedfad3-7515-4e73-8fc7-a846efbbb5d6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:49.726839 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2fedfad3-7515-4e73-8fc7-a846efbbb5d6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:49.727417 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2fedfad3-7515-4e73-8fc7-a846efbbb5d6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:49.877358 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=8 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:49.919177 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2fedfad3-7515-4e73-8fc7-a846efbbb5d6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:49.922784 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:49.928116 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2fedfad3-7515-4e73-8fc7-a846efbbb5d6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:49.930479 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2fedfad3-7515-4e73-8fc7-a846efbbb5d6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:49.931710 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2fedfad3-7515-4e73-8fc7-a846efbbb5d6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.219132 Jun 14 19:47:49.932369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 362/753] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:49 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:50.525949 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-64f2db99-cb34-4744-8fcf-2404bf10751c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:50.526736 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-64f2db99-cb34-4744-8fcf-2404bf10751c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:50.535761 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-64f2db99-cb34-4744-8fcf-2404bf10751c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:50.536200 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-64f2db99-cb34-4744-8fcf-2404bf10751c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:50.537216 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-64f2db99-cb34-4744-8fcf-2404bf10751c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:50.537790 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-64f2db99-cb34-4744-8fcf-2404bf10751c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:50.723788 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-64f2db99-cb34-4744-8fcf-2404bf10751c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:50.731779 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-64f2db99-cb34-4744-8fcf-2404bf10751c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1319 microversion: 2.1 time: 0.211603 Jun 14 19:47:50.732333 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 363/754] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:50 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:47:50.736613 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-77d038d7-a075-4580-b0f3-9a04bde4b54c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:50.737203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-77d038d7-a075-4580-b0f3-9a04bde4b54c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:50.745143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-77d038d7-a075-4580-b0f3-9a04bde4b54c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:50.745690 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-77d038d7-a075-4580-b0f3-9a04bde4b54c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:50.746650 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-77d038d7-a075-4580-b0f3-9a04bde4b54c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:50.747219 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-77d038d7-a075-4580-b0f3-9a04bde4b54c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:50.892484 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-77d038d7-a075-4580-b0f3-9a04bde4b54c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:50.900466 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-77d038d7-a075-4580-b0f3-9a04bde4b54c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1519 microversion: 2.1 time: 0.167143 Jun 14 19:47:50.901041 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 364/755] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:50 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:50.951141 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a5906731-678b-4764-a2ff-59031f58fff7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:50.951849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a5906731-678b-4764-a2ff-59031f58fff7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:50.958099 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a5906731-678b-4764-a2ff-59031f58fff7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:50.958541 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a5906731-678b-4764-a2ff-59031f58fff7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:50.959288 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a5906731-678b-4764-a2ff-59031f58fff7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:50.959718 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a5906731-678b-4764-a2ff-59031f58fff7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:51.107281 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a5906731-678b-4764-a2ff-59031f58fff7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:51.115459 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a5906731-678b-4764-a2ff-59031f58fff7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:51.117734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a5906731-678b-4764-a2ff-59031f58fff7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:51.118884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a5906731-678b-4764-a2ff-59031f58fff7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.171720 Jun 14 19:47:51.119432 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 365/756] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:50 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:47:51.748255 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-e6d2618d-ebe6-4456-8b70-aee472fdf571 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:51.748949 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-e6d2618d-ebe6-4456-8b70-aee472fdf571 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:51.755472 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e6d2618d-ebe6-4456-8b70-aee472fdf571 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:51.756002 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e6d2618d-ebe6-4456-8b70-aee472fdf571 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:51.757587 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e6d2618d-ebe6-4456-8b70-aee472fdf571 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:51.758533 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e6d2618d-ebe6-4456-8b70-aee472fdf571 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:51.905025 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e6d2618d-ebe6-4456-8b70-aee472fdf571 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:51.912844 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-e6d2618d-ebe6-4456-8b70-aee472fdf571 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1319 microversion: 2.1 time: 0.168292 Jun 14 19:47:51.913477 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 366/757] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:51 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:51.917959 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6712c934-46c7-4be8-a424-514c011274a7 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:51.918585 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-6712c934-46c7-4be8-a424-514c011274a7 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:51.924406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6712c934-46c7-4be8-a424-514c011274a7 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:51.924849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6712c934-46c7-4be8-a424-514c011274a7 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:51.925631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6712c934-46c7-4be8-a424-514c011274a7 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:51.926065 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6712c934-46c7-4be8-a424-514c011274a7 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:52.064982 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-6712c934-46c7-4be8-a424-514c011274a7 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:52.075451 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6712c934-46c7-4be8-a424-514c011274a7 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1519 microversion: 2.1 time: 0.160911 Jun 14 19:47:52.076030 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 367/758] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:51 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:52.136791 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-fb48dab3-3bfd-4bf3-89ee-1d04567802aa tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:52.137421 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-fb48dab3-3bfd-4bf3-89ee-1d04567802aa tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:52.143555 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fb48dab3-3bfd-4bf3-89ee-1d04567802aa tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:52.143991 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fb48dab3-3bfd-4bf3-89ee-1d04567802aa tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:52.144745 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fb48dab3-3bfd-4bf3-89ee-1d04567802aa tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:52.145174 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fb48dab3-3bfd-4bf3-89ee-1d04567802aa tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:52.291884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-fb48dab3-3bfd-4bf3-89ee-1d04567802aa tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:52.300796 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-fb48dab3-3bfd-4bf3-89ee-1d04567802aa tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:52.302507 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-fb48dab3-3bfd-4bf3-89ee-1d04567802aa tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:52.304696 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-fb48dab3-3bfd-4bf3-89ee-1d04567802aa tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.170815 Jun 14 19:47:52.305613 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 368/759] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:52 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:47:52.930325 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ec680fad-16b4-4c75-b349-791d9bf4e033 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:52.931064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ec680fad-16b4-4c75-b349-791d9bf4e033 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:52.937498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ec680fad-16b4-4c75-b349-791d9bf4e033 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:52.937943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ec680fad-16b4-4c75-b349-791d9bf4e033 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:52.938703 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ec680fad-16b4-4c75-b349-791d9bf4e033 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:52.939132 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ec680fad-16b4-4c75-b349-791d9bf4e033 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:53.074117 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-ec680fad-16b4-4c75-b349-791d9bf4e033 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:53.081506 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-ec680fad-16b4-4c75-b349-791d9bf4e033 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1319 microversion: 2.1 time: 0.155779 Jun 14 19:47:53.082065 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 369/760] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:52 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:47:53.091763 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a5749477-e770-4167-9609-3d9acaf9eafc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:53.092357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a5749477-e770-4167-9609-3d9acaf9eafc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:53.098113 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a5749477-e770-4167-9609-3d9acaf9eafc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:53.098557 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a5749477-e770-4167-9609-3d9acaf9eafc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:53.099299 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a5749477-e770-4167-9609-3d9acaf9eafc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:53.099726 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a5749477-e770-4167-9609-3d9acaf9eafc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:53.234839 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a5749477-e770-4167-9609-3d9acaf9eafc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:53.242296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a5749477-e770-4167-9609-3d9acaf9eafc tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1519 microversion: 2.1 time: 0.154136 Jun 14 19:47:53.242859 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 370/761] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:53 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:47:53.322653 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-32affd98-c95a-44e8-af32-5fe14b0390f1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:53.323198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-32affd98-c95a-44e8-af32-5fe14b0390f1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:53.328966 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-32affd98-c95a-44e8-af32-5fe14b0390f1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:53.329444 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-32affd98-c95a-44e8-af32-5fe14b0390f1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:53.330209 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-32affd98-c95a-44e8-af32-5fe14b0390f1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:53.330663 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-32affd98-c95a-44e8-af32-5fe14b0390f1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:53.460598 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-32affd98-c95a-44e8-af32-5fe14b0390f1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:53.469107 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-32affd98-c95a-44e8-af32-5fe14b0390f1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:53.470650 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-32affd98-c95a-44e8-af32-5fe14b0390f1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:53.471829 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-32affd98-c95a-44e8-af32-5fe14b0390f1 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.153376 Jun 14 19:47:53.472386 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 371/762] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:53 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:47:54.021884 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-8e3a6191-5419-425d-b818-2ea17165003e tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "POST /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.025155 Jun 14 19:47:54.023251 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 392/763] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 14 19:47:48 2022] POST /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments => generated 194 bytes in 5027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:54.098685 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-972f9fdb-7780-4bbf-b0b7-d758fa604060 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:54.099381 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-972f9fdb-7780-4bbf-b0b7-d758fa604060 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:54.106019 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-972f9fdb-7780-4bbf-b0b7-d758fa604060 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:54.106468 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-972f9fdb-7780-4bbf-b0b7-d758fa604060 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:54.107219 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-972f9fdb-7780-4bbf-b0b7-d758fa604060 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:54.107649 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-972f9fdb-7780-4bbf-b0b7-d758fa604060 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:54.238013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-972f9fdb-7780-4bbf-b0b7-d758fa604060 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:54.245345 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-972f9fdb-7780-4bbf-b0b7-d758fa604060 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1319 microversion: 2.1 time: 0.150431 Jun 14 19:47:54.245929 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 372/764] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:54 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:54.260566 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d7248541-0ffb-4eec-91a1-54980893b62d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:54.261298 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d7248541-0ffb-4eec-91a1-54980893b62d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:54.267535 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d7248541-0ffb-4eec-91a1-54980893b62d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:54.267987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d7248541-0ffb-4eec-91a1-54980893b62d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:54.268750 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d7248541-0ffb-4eec-91a1-54980893b62d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:54.269187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d7248541-0ffb-4eec-91a1-54980893b62d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:54.399040 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d7248541-0ffb-4eec-91a1-54980893b62d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:54.406504 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d7248541-0ffb-4eec-91a1-54980893b62d tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1521 microversion: 2.1 time: 0.151108 Jun 14 19:47:54.407067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 393/765] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:54 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:54.489942 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-930f20a2-5932-45d6-9c6e-7546f16f75b8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:54.490551 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-930f20a2-5932-45d6-9c6e-7546f16f75b8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:54.496949 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-930f20a2-5932-45d6-9c6e-7546f16f75b8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:54.497416 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-930f20a2-5932-45d6-9c6e-7546f16f75b8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:54.498177 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-930f20a2-5932-45d6-9c6e-7546f16f75b8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:54.498639 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-930f20a2-5932-45d6-9c6e-7546f16f75b8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:54.648393 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-930f20a2-5932-45d6-9c6e-7546f16f75b8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:54.657680 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-930f20a2-5932-45d6-9c6e-7546f16f75b8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:54.659330 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-930f20a2-5932-45d6-9c6e-7546f16f75b8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:54.660507 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-930f20a2-5932-45d6-9c6e-7546f16f75b8 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.174505 Jun 14 19:47:54.661049 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 373/766] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:54 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:55.263073 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-ae4eaa2b-e324-4395-ba7f-188dea088410 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:55.263894 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-ae4eaa2b-e324-4395-ba7f-188dea088410 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:55.270533 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ae4eaa2b-e324-4395-ba7f-188dea088410 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:55.270982 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ae4eaa2b-e324-4395-ba7f-188dea088410 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:55.271749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ae4eaa2b-e324-4395-ba7f-188dea088410 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:55.272186 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ae4eaa2b-e324-4395-ba7f-188dea088410 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:55.287939 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:55.404628 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ae4eaa2b-e324-4395-ba7f-188dea088410 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:55.411949 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-ae4eaa2b-e324-4395-ba7f-188dea088410 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1319 microversion: 2.1 time: 0.152781 Jun 14 19:47:55.412513 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 394/767] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:55 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:55.423530 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-0900755c-1b62-4215-b32c-d474fa392ae8 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:55.424204 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-0900755c-1b62-4215-b32c-d474fa392ae8 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:55.431661 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0900755c-1b62-4215-b32c-d474fa392ae8 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:55.432136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0900755c-1b62-4215-b32c-d474fa392ae8 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:55.433043 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0900755c-1b62-4215-b32c-d474fa392ae8 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:55.433515 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0900755c-1b62-4215-b32c-d474fa392ae8 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:55.566932 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-0900755c-1b62-4215-b32c-d474fa392ae8 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:55.574749 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-0900755c-1b62-4215-b32c-d474fa392ae8 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1521 microversion: 2.1 time: 0.155131 Jun 14 19:47:55.575316 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 374/768] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:55 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:55.680353 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-47c134fa-fa62-4a0f-bd50-20e2e6114cc3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:55.680865 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-47c134fa-fa62-4a0f-bd50-20e2e6114cc3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:55.686926 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-47c134fa-fa62-4a0f-bd50-20e2e6114cc3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:55.687377 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-47c134fa-fa62-4a0f-bd50-20e2e6114cc3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:55.688140 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-47c134fa-fa62-4a0f-bd50-20e2e6114cc3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:55.688574 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-47c134fa-fa62-4a0f-bd50-20e2e6114cc3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:55.823994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-47c134fa-fa62-4a0f-bd50-20e2e6114cc3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:55.831967 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-47c134fa-fa62-4a0f-bd50-20e2e6114cc3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:55.833499 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-47c134fa-fa62-4a0f-bd50-20e2e6114cc3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:55.835212 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-47c134fa-fa62-4a0f-bd50-20e2e6114cc3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.159905 Jun 14 19:47:55.835751 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 395/769] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:55 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:56.147722 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-934355ec-1d1e-4715-9efa-995e1e28394a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:56.148345 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-934355ec-1d1e-4715-9efa-995e1e28394a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:56.155220 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-934355ec-1d1e-4715-9efa-995e1e28394a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:56.155722 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-934355ec-1d1e-4715-9efa-995e1e28394a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:56.156707 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-934355ec-1d1e-4715-9efa-995e1e28394a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:56.157147 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-934355ec-1d1e-4715-9efa-995e1e28394a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:56.245328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.objects.instance [None req-934355ec-1d1e-4715-9efa-995e1e28394a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lazy-loading 'services' on Instance uuid 906a717b-f3cc-4340-b6b6-7c47ef2ac058 {{(pid=124069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:47:56.315392 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-934355ec-1d1e-4715-9efa-995e1e28394a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "DELETE /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments/a41955ab-007b-4b2d-baef-46ddd19ce603" status: 202 len: 0 microversion: 2.1 time: 0.172213 Jun 14 19:47:56.315984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 375/770] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 14 19:47:56 2022] DELETE /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments/a41955ab-007b-4b2d-baef-46ddd19ce603 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:47:56.324405 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a70ba41b-d3a5-4712-8104-5f6f4d0da167 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:56.325468 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a70ba41b-d3a5-4712-8104-5f6f4d0da167 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:56.331418 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a70ba41b-d3a5-4712-8104-5f6f4d0da167 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:56.331861 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a70ba41b-d3a5-4712-8104-5f6f4d0da167 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:56.332649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a70ba41b-d3a5-4712-8104-5f6f4d0da167 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:56.333076 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a70ba41b-d3a5-4712-8104-5f6f4d0da167 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:56.362276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a70ba41b-d3a5-4712-8104-5f6f4d0da167 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041688 Jun 14 19:47:56.362760 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 396/771] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:47:56 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:56.429465 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8437b47f-75f2-4feb-a660-9f47f789e2ec tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:56.430173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8437b47f-75f2-4feb-a660-9f47f789e2ec tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:56.436765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8437b47f-75f2-4feb-a660-9f47f789e2ec tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:56.437198 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8437b47f-75f2-4feb-a660-9f47f789e2ec tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:56.437991 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8437b47f-75f2-4feb-a660-9f47f789e2ec tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:56.438426 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8437b47f-75f2-4feb-a660-9f47f789e2ec tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:56.579904 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8437b47f-75f2-4feb-a660-9f47f789e2ec tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:56.590004 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8437b47f-75f2-4feb-a660-9f47f789e2ec tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1319 microversion: 2.1 time: 0.164774 Jun 14 19:47:56.591961 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 376/772] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:56 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:56.592246 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-297872f4-0374-4334-9cfa-b941b2193517 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:56.592957 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-297872f4-0374-4334-9cfa-b941b2193517 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:56.599235 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-297872f4-0374-4334-9cfa-b941b2193517 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:56.599685 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-297872f4-0374-4334-9cfa-b941b2193517 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:56.601030 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-297872f4-0374-4334-9cfa-b941b2193517 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:56.601429 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-297872f4-0374-4334-9cfa-b941b2193517 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:56.841519 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-297872f4-0374-4334-9cfa-b941b2193517 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:56.852726 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-297872f4-0374-4334-9cfa-b941b2193517 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1577 microversion: 2.1 time: 0.264681 Jun 14 19:47:56.853965 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-51435ee1-3ab7-4178-a038-9ebaec5e6ae7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:56.854189 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 397/773] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:56 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1577 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:47:56.854988 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-51435ee1-3ab7-4178-a038-9ebaec5e6ae7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:56.858114 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:56.861932 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-51435ee1-3ab7-4178-a038-9ebaec5e6ae7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:56.862593 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-51435ee1-3ab7-4178-a038-9ebaec5e6ae7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:56.863351 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-51435ee1-3ab7-4178-a038-9ebaec5e6ae7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:56.863950 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-51435ee1-3ab7-4178-a038-9ebaec5e6ae7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:57.006144 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-51435ee1-3ab7-4178-a038-9ebaec5e6ae7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:57.016536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-51435ee1-3ab7-4178-a038-9ebaec5e6ae7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:57.018073 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-51435ee1-3ab7-4178-a038-9ebaec5e6ae7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:57.019249 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-51435ee1-3ab7-4178-a038-9ebaec5e6ae7 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.170105 Jun 14 19:47:57.020143 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 377/774] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:56 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:57.374085 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-7f25acba-bb8c-4579-a47d-3d6be46e4f1d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:57.374962 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-7f25acba-bb8c-4579-a47d-3d6be46e4f1d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:57.380878 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7f25acba-bb8c-4579-a47d-3d6be46e4f1d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:57.381388 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7f25acba-bb8c-4579-a47d-3d6be46e4f1d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:57.382359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7f25acba-bb8c-4579-a47d-3d6be46e4f1d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:57.382790 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7f25acba-bb8c-4579-a47d-3d6be46e4f1d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:57.411904 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-7f25acba-bb8c-4579-a47d-3d6be46e4f1d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041886 Jun 14 19:47:57.412456 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 398/775] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:47:57 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:57.607085 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-28349baa-47b9-459d-81fa-367d9fed6712 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:57.607732 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-28349baa-47b9-459d-81fa-367d9fed6712 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:57.614242 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-28349baa-47b9-459d-81fa-367d9fed6712 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:57.614785 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-28349baa-47b9-459d-81fa-367d9fed6712 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:57.615547 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-28349baa-47b9-459d-81fa-367d9fed6712 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:57.615984 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-28349baa-47b9-459d-81fa-367d9fed6712 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:57.749802 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-28349baa-47b9-459d-81fa-367d9fed6712 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:57.753277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:57.759122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-28349baa-47b9-459d-81fa-367d9fed6712 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1319 microversion: 2.1 time: 0.155709 Jun 14 19:47:57.759683 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 378/776] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:57 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:57.872040 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0335b53b-5f13-4ffb-92f1-15471eb8e8f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:57.872647 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-0335b53b-5f13-4ffb-92f1-15471eb8e8f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:57.878914 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0335b53b-5f13-4ffb-92f1-15471eb8e8f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:57.879369 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0335b53b-5f13-4ffb-92f1-15471eb8e8f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:57.880128 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0335b53b-5f13-4ffb-92f1-15471eb8e8f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:57.880559 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0335b53b-5f13-4ffb-92f1-15471eb8e8f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:58.011755 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0335b53b-5f13-4ffb-92f1-15471eb8e8f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:58.019279 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-0335b53b-5f13-4ffb-92f1-15471eb8e8f6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1577 microversion: 2.1 time: 0.151095 Jun 14 19:47:58.019848 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 399/777] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:57 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:58.039679 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9918dfa3-3607-4ff2-85cb-3b617a7b482f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:58.040283 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9918dfa3-3607-4ff2-85cb-3b617a7b482f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:58.046536 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9918dfa3-3607-4ff2-85cb-3b617a7b482f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:58.046990 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9918dfa3-3607-4ff2-85cb-3b617a7b482f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:58.047745 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9918dfa3-3607-4ff2-85cb-3b617a7b482f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:58.048178 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9918dfa3-3607-4ff2-85cb-3b617a7b482f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:58.174734 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9918dfa3-3607-4ff2-85cb-3b617a7b482f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:58.183558 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9918dfa3-3607-4ff2-85cb-3b617a7b482f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:58.185042 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9918dfa3-3607-4ff2-85cb-3b617a7b482f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:58.186356 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9918dfa3-3607-4ff2-85cb-3b617a7b482f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.151431 Jun 14 19:47:58.186914 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 379/778] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:58 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:58.423687 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3e6d2baf-a6a7-44c3-af6f-dbdb346bb013 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:58.424603 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3e6d2baf-a6a7-44c3-af6f-dbdb346bb013 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:58.430783 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3e6d2baf-a6a7-44c3-af6f-dbdb346bb013 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:58.431232 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3e6d2baf-a6a7-44c3-af6f-dbdb346bb013 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:58.431996 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3e6d2baf-a6a7-44c3-af6f-dbdb346bb013 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:58.432435 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3e6d2baf-a6a7-44c3-af6f-dbdb346bb013 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:58.462789 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3e6d2baf-a6a7-44c3-af6f-dbdb346bb013 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043080 Jun 14 19:47:58.463341 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 400/779] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:47:58 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:58.776949 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-877ec4ff-3839-4900-98a1-c1798e6c691a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:58.777593 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-877ec4ff-3839-4900-98a1-c1798e6c691a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:58.783753 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-877ec4ff-3839-4900-98a1-c1798e6c691a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:58.784196 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-877ec4ff-3839-4900-98a1-c1798e6c691a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:58.785028 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-877ec4ff-3839-4900-98a1-c1798e6c691a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:58.785496 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-877ec4ff-3839-4900-98a1-c1798e6c691a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:58.932848 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-877ec4ff-3839-4900-98a1-c1798e6c691a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:58.941893 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-877ec4ff-3839-4900-98a1-c1798e6c691a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1319 microversion: 2.1 time: 0.169628 Jun 14 19:47:58.943258 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 380/780] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:58 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:58.992446 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-b1d6fad7-41d0-4349-b3b2-cba23d8c9f47 req-3a432cf4-9806-4fc7-aa50-26a78bbb2823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5b449e-0612-4e56-963b-5841afefea1c", "name": "network-vif-plugged", "status": "completed", "tag": "94c03a74-6929-4077-a3f8-7be44d15be23"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:47:59.001938 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-b1d6fad7-41d0-4349-b3b2-cba23d8c9f47 req-3a432cf4-9806-4fc7-aa50-26a78bbb2823 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:59.002628 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-b1d6fad7-41d0-4349-b3b2-cba23d8c9f47 req-3a432cf4-9806-4fc7-aa50-26a78bbb2823 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:59.015935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-b1d6fad7-41d0-4349-b3b2-cba23d8c9f47 req-3a432cf4-9806-4fc7-aa50-26a78bbb2823 service nova] Creating event network-vif-plugged:94c03a74-6929-4077-a3f8-7be44d15be23 for instance 5d5b449e-0612-4e56-963b-5841afefea1c on hv-cinder-84580 Jun 14 19:47:59.020776 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-b1d6fad7-41d0-4349-b3b2-cba23d8c9f47 req-3a432cf4-9806-4fc7-aa50-26a78bbb2823 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033659 Jun 14 19:47:59.021701 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 401/781] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:47:59.037190 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-11d514a9-28b4-4fcf-bd3a-c7b7cdbf0fc4 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:59.038461 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-11d514a9-28b4-4fcf-bd3a-c7b7cdbf0fc4 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:59.044846 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-11d514a9-28b4-4fcf-bd3a-c7b7cdbf0fc4 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:59.045548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-11d514a9-28b4-4fcf-bd3a-c7b7cdbf0fc4 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:59.046501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-11d514a9-28b4-4fcf-bd3a-c7b7cdbf0fc4 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:59.047090 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-11d514a9-28b4-4fcf-bd3a-c7b7cdbf0fc4 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:59.198261 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-11d514a9-28b4-4fcf-bd3a-c7b7cdbf0fc4 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:59.204617 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-af3c3761-5bc9-4599-a365-11bc1dbf53fe tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:59.208971 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-af3c3761-5bc9-4599-a365-11bc1dbf53fe tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:59.216565 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-11d514a9-28b4-4fcf-bd3a-c7b7cdbf0fc4 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1577 microversion: 2.1 time: 0.183100 Jun 14 19:47:59.218420 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 381/782] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:59 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:47:59.221723 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-af3c3761-5bc9-4599-a365-11bc1dbf53fe tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:59.222419 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-af3c3761-5bc9-4599-a365-11bc1dbf53fe tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:59.223336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-af3c3761-5bc9-4599-a365-11bc1dbf53fe tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:59.223923 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-af3c3761-5bc9-4599-a365-11bc1dbf53fe tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:59.361673 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-af3c3761-5bc9-4599-a365-11bc1dbf53fe tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:59.370498 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-af3c3761-5bc9-4599-a365-11bc1dbf53fe tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:59.372296 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-af3c3761-5bc9-4599-a365-11bc1dbf53fe tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:47:59.373993 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-af3c3761-5bc9-4599-a365-11bc1dbf53fe tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.173697 Jun 14 19:47:59.374593 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 402/783] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:47:59 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:47:59.474186 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b41c0f45-fe25-44f6-aed0-77605f40b110 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:59.475675 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b41c0f45-fe25-44f6-aed0-77605f40b110 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:59.481719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b41c0f45-fe25-44f6-aed0-77605f40b110 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:59.482160 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b41c0f45-fe25-44f6-aed0-77605f40b110 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:59.482904 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b41c0f45-fe25-44f6-aed0-77605f40b110 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:59.483334 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b41c0f45-fe25-44f6-aed0-77605f40b110 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:59.512472 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b41c0f45-fe25-44f6-aed0-77605f40b110 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042161 Jun 14 19:47:59.513022 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 382/784] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:47:59 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:47:59.960673 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-10e3a792-8307-4458-8b89-50dcf53e9e3f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:47:59.961276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-10e3a792-8307-4458-8b89-50dcf53e9e3f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:47:59.967303 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-10e3a792-8307-4458-8b89-50dcf53e9e3f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:59.967748 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-10e3a792-8307-4458-8b89-50dcf53e9e3f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:47:59.968498 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-10e3a792-8307-4458-8b89-50dcf53e9e3f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:47:59.968932 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-10e3a792-8307-4458-8b89-50dcf53e9e3f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:00.099280 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-10e3a792-8307-4458-8b89-50dcf53e9e3f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:00.107491 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-10e3a792-8307-4458-8b89-50dcf53e9e3f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1319 microversion: 2.1 time: 0.151424 Jun 14 19:48:00.108057 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 403/785] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:47:59 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:00.234518 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4266d616-cd78-4e8b-9e9d-32bf0df76d24 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:00.235165 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4266d616-cd78-4e8b-9e9d-32bf0df76d24 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:00.241826 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4266d616-cd78-4e8b-9e9d-32bf0df76d24 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:00.242272 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4266d616-cd78-4e8b-9e9d-32bf0df76d24 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:00.243028 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4266d616-cd78-4e8b-9e9d-32bf0df76d24 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:00.243460 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4266d616-cd78-4e8b-9e9d-32bf0df76d24 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:00.376986 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4266d616-cd78-4e8b-9e9d-32bf0df76d24 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:00.387683 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4266d616-cd78-4e8b-9e9d-32bf0df76d24 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1577 microversion: 2.1 time: 0.156288 Jun 14 19:48:00.388463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 383/786] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:00 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:00.392330 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a30e8209-8f78-41c4-9055-8c233747f53f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:00.392967 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a30e8209-8f78-41c4-9055-8c233747f53f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:00.399538 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a30e8209-8f78-41c4-9055-8c233747f53f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:00.399987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a30e8209-8f78-41c4-9055-8c233747f53f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:00.400757 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a30e8209-8f78-41c4-9055-8c233747f53f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:00.401192 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a30e8209-8f78-41c4-9055-8c233747f53f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:00.524718 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b793b01f-6ac9-4ebc-8f44-180caf1e39fe tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:00.525702 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b793b01f-6ac9-4ebc-8f44-180caf1e39fe tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:00.531908 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b793b01f-6ac9-4ebc-8f44-180caf1e39fe tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:00.532472 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b793b01f-6ac9-4ebc-8f44-180caf1e39fe tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:00.533245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b793b01f-6ac9-4ebc-8f44-180caf1e39fe tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:00.533745 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b793b01f-6ac9-4ebc-8f44-180caf1e39fe tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:00.539076 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a30e8209-8f78-41c4-9055-8c233747f53f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:00.547019 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a30e8209-8f78-41c4-9055-8c233747f53f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:00.548513 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a30e8209-8f78-41c4-9055-8c233747f53f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:00.549689 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a30e8209-8f78-41c4-9055-8c233747f53f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.161103 Jun 14 19:48:00.550255 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 404/787] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:48:00 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 19:48:00.563395 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b793b01f-6ac9-4ebc-8f44-180caf1e39fe tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043299 Jun 14 19:48:00.563946 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 384/788] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:48:00 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:48:01.063236 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-b26d5fa0-bb3d-49f0-9d95-6470205b035c req-3969f9af-b729-45b5-989c-a839410d8c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574d3163-12b7-4f68-9f90-445a0d1b0b8e", "name": "network-vif-plugged", "status": "completed", "tag": "367ce7c0-470d-4698-8a1e-52c8e78f7f64"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:48:01.072622 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-b26d5fa0-bb3d-49f0-9d95-6470205b035c req-3969f9af-b729-45b5-989c-a839410d8c2c service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:01.073005 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-b26d5fa0-bb3d-49f0-9d95-6470205b035c req-3969f9af-b729-45b5-989c-a839410d8c2c service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:01.083537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-b26d5fa0-bb3d-49f0-9d95-6470205b035c req-3969f9af-b729-45b5-989c-a839410d8c2c service nova] Creating event network-vif-plugged:367ce7c0-470d-4698-8a1e-52c8e78f7f64 for instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e on hv-cinder-84580 Jun 14 19:48:01.089161 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-b26d5fa0-bb3d-49f0-9d95-6470205b035c req-3969f9af-b729-45b5-989c-a839410d8c2c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029577 Jun 14 19:48:01.089760 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 405/789] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:48:01.124060 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-615dcd8c-aa16-479b-a353-374a37bb8f8f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:01.124678 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-615dcd8c-aa16-479b-a353-374a37bb8f8f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:01.130890 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-615dcd8c-aa16-479b-a353-374a37bb8f8f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:01.131348 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-615dcd8c-aa16-479b-a353-374a37bb8f8f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:01.132138 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-615dcd8c-aa16-479b-a353-374a37bb8f8f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:01.132570 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-615dcd8c-aa16-479b-a353-374a37bb8f8f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:01.274385 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-615dcd8c-aa16-479b-a353-374a37bb8f8f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:01.281980 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-615dcd8c-aa16-479b-a353-374a37bb8f8f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1507 microversion: 2.1 time: 0.161891 Jun 14 19:48:01.282546 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 385/790] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:01 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:01.405763 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-7002ccd9-6f45-4f9c-b9e5-2ca1a331a14b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:01.406466 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-7002ccd9-6f45-4f9c-b9e5-2ca1a331a14b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:01.413490 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7002ccd9-6f45-4f9c-b9e5-2ca1a331a14b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:01.414029 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7002ccd9-6f45-4f9c-b9e5-2ca1a331a14b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:01.414836 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7002ccd9-6f45-4f9c-b9e5-2ca1a331a14b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:01.415274 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7002ccd9-6f45-4f9c-b9e5-2ca1a331a14b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:01.555226 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-7002ccd9-6f45-4f9c-b9e5-2ca1a331a14b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:01.563102 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-7002ccd9-6f45-4f9c-b9e5-2ca1a331a14b tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1577 microversion: 2.1 time: 0.161819 Jun 14 19:48:01.564011 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 406/791] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:01 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:01.568084 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2d672de2-6253-4158-8cda-321f79cb190d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:01.568759 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2d672de2-6253-4158-8cda-321f79cb190d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:01.575384 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e69ed366-79f9-4e1b-a08c-25984fda0130 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:01.576458 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e69ed366-79f9-4e1b-a08c-25984fda0130 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:01.578225 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2d672de2-6253-4158-8cda-321f79cb190d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:01.578850 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2d672de2-6253-4158-8cda-321f79cb190d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:01.579849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2d672de2-6253-4158-8cda-321f79cb190d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:01.580431 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2d672de2-6253-4158-8cda-321f79cb190d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:01.583237 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e69ed366-79f9-4e1b-a08c-25984fda0130 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:01.583764 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e69ed366-79f9-4e1b-a08c-25984fda0130 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:01.584533 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e69ed366-79f9-4e1b-a08c-25984fda0130 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:01.584961 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e69ed366-79f9-4e1b-a08c-25984fda0130 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:01.616874 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e69ed366-79f9-4e1b-a08c-25984fda0130 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 Jun 14 19:48:01.620742 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 407/792] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:48:01 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:48:01.733921 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2d672de2-6253-4158-8cda-321f79cb190d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:01.742380 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2d672de2-6253-4158-8cda-321f79cb190d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:01.743876 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2d672de2-6253-4158-8cda-321f79cb190d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:01.745040 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2d672de2-6253-4158-8cda-321f79cb190d tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.180835 Jun 14 19:48:01.745623 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 386/793] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:48:01 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:48:02.580301 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4cf7e77c-e346-40dd-bb19-5e8159fb5815 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:02.581104 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4cf7e77c-e346-40dd-bb19-5e8159fb5815 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:02.590026 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4cf7e77c-e346-40dd-bb19-5e8159fb5815 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:02.590857 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4cf7e77c-e346-40dd-bb19-5e8159fb5815 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:02.591966 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4cf7e77c-e346-40dd-bb19-5e8159fb5815 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:02.592639 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4cf7e77c-e346-40dd-bb19-5e8159fb5815 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:02.628196 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b4051735-8b4a-4ef6-adc5-85797da000c5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:02.629209 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b4051735-8b4a-4ef6-adc5-85797da000c5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:02.637091 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b4051735-8b4a-4ef6-adc5-85797da000c5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:02.637577 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b4051735-8b4a-4ef6-adc5-85797da000c5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:02.638348 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b4051735-8b4a-4ef6-adc5-85797da000c5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:02.638782 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b4051735-8b4a-4ef6-adc5-85797da000c5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:02.671739 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b4051735-8b4a-4ef6-adc5-85797da000c5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047440 Jun 14 19:48:02.672441 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 387/794] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:48:02 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:48:02.740235 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4cf7e77c-e346-40dd-bb19-5e8159fb5815 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:02.748403 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4cf7e77c-e346-40dd-bb19-5e8159fb5815 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1577 microversion: 2.1 time: 0.171971 Jun 14 19:48:02.748962 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 408/795] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:02 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:02.764344 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8d6fb871-fd0b-42f3-9104-337aa666e469 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:02.764996 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8d6fb871-fd0b-42f3-9104-337aa666e469 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:02.771211 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8d6fb871-fd0b-42f3-9104-337aa666e469 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:02.771663 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8d6fb871-fd0b-42f3-9104-337aa666e469 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:02.772426 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8d6fb871-fd0b-42f3-9104-337aa666e469 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:02.773696 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8d6fb871-fd0b-42f3-9104-337aa666e469 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:02.936132 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8d6fb871-fd0b-42f3-9104-337aa666e469 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:02.944203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8d6fb871-fd0b-42f3-9104-337aa666e469 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:02.946620 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8d6fb871-fd0b-42f3-9104-337aa666e469 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:02.947882 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8d6fb871-fd0b-42f3-9104-337aa666e469 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1732 microversion: 2.20 time: 0.187648 Jun 14 19:48:02.948570 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 388/796] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:48:02 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:48:03.684124 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3a3acbdc-f181-42ef-8148-172be60d9959 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:03.684959 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3a3acbdc-f181-42ef-8148-172be60d9959 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:03.691612 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3a3acbdc-f181-42ef-8148-172be60d9959 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:03.692065 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3a3acbdc-f181-42ef-8148-172be60d9959 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:03.692862 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3a3acbdc-f181-42ef-8148-172be60d9959 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:03.693328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3a3acbdc-f181-42ef-8148-172be60d9959 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:03.723805 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3a3acbdc-f181-42ef-8148-172be60d9959 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044594 Jun 14 19:48:03.724375 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 409/797] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:48:03 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:48:03.764879 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4a467708-5ea4-46c7-9c24-669a64baeb54 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:03.765512 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4a467708-5ea4-46c7-9c24-669a64baeb54 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:03.772036 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4a467708-5ea4-46c7-9c24-669a64baeb54 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:03.772847 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4a467708-5ea4-46c7-9c24-669a64baeb54 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:03.773765 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4a467708-5ea4-46c7-9c24-669a64baeb54 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:03.774200 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4a467708-5ea4-46c7-9c24-669a64baeb54 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:03.820176 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-dda28d42-b828-478d-bfc0-6ce12f893f57 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:03.825627 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-dda28d42-b828-478d-bfc0-6ce12f893f57 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:03.832447 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dda28d42-b828-478d-bfc0-6ce12f893f57 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:03.832895 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dda28d42-b828-478d-bfc0-6ce12f893f57 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:03.833705 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dda28d42-b828-478d-bfc0-6ce12f893f57 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:03.834135 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dda28d42-b828-478d-bfc0-6ce12f893f57 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:03.863861 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-dda28d42-b828-478d-bfc0-6ce12f893f57 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048255 Jun 14 19:48:03.864423 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 410/798] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:48:03 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:48:03.875474 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-cc3f82b1-f12a-43ad-9098-636efa8c0d2d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:03.875970 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-cc3f82b1-f12a-43ad-9098-636efa8c0d2d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:03.881951 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cc3f82b1-f12a-43ad-9098-636efa8c0d2d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:03.882699 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cc3f82b1-f12a-43ad-9098-636efa8c0d2d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:03.883138 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cc3f82b1-f12a-43ad-9098-636efa8c0d2d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:03.883570 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-cc3f82b1-f12a-43ad-9098-636efa8c0d2d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:03.909572 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4a467708-5ea4-46c7-9c24-669a64baeb54 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:03.912831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-cc3f82b1-f12a-43ad-9098-636efa8c0d2d tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments/add3b722-89f0-4233-b393-d8791eb0ae10" status: 200 len: 194 microversion: 2.1 time: 0.041800 Jun 14 19:48:03.914021 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 411/799] 10.222.0.44 () {58 vars in 1412 bytes} [Tue Jun 14 19:48:03 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments/add3b722-89f0-4233-b393-d8791eb0ae10 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:48:03.918320 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4a467708-5ea4-46c7-9c24-669a64baeb54 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1577 microversion: 2.1 time: 0.157087 Jun 14 19:48:03.918996 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 389/800] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:03 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:03.966794 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f75d86a8-80bd-4dc6-8492-80a90b2444bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:03.967408 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f75d86a8-80bd-4dc6-8492-80a90b2444bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:03.973592 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f75d86a8-80bd-4dc6-8492-80a90b2444bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:03.974044 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f75d86a8-80bd-4dc6-8492-80a90b2444bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:03.974816 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f75d86a8-80bd-4dc6-8492-80a90b2444bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:03.975249 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f75d86a8-80bd-4dc6-8492-80a90b2444bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:03.990166 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=100 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:04.112604 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-f75d86a8-80bd-4dc6-8492-80a90b2444bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:04.122750 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-f75d86a8-80bd-4dc6-8492-80a90b2444bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:04.124261 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-f75d86a8-80bd-4dc6-8492-80a90b2444bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:04.125510 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f75d86a8-80bd-4dc6-8492-80a90b2444bc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1719 microversion: 2.20 time: 0.162586 Jun 14 19:48:04.126068 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 412/801] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:48:03 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:48:04.736527 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-411f8f1a-66c1-4585-9cb0-006998cb5ad6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:04.737475 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-411f8f1a-66c1-4585-9cb0-006998cb5ad6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:04.744818 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-411f8f1a-66c1-4585-9cb0-006998cb5ad6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:04.745274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-411f8f1a-66c1-4585-9cb0-006998cb5ad6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:04.746137 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-411f8f1a-66c1-4585-9cb0-006998cb5ad6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:04.746641 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-411f8f1a-66c1-4585-9cb0-006998cb5ad6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:04.775558 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-411f8f1a-66c1-4585-9cb0-006998cb5ad6 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042984 Jun 14 19:48:04.776216 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 390/802] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:48:04 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 19:48:04.835680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a2563b3c-880c-43ee-89a3-e38dde7b4a3f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:04.836773 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a2563b3c-880c-43ee-89a3-e38dde7b4a3f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:04.843453 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2563b3c-880c-43ee-89a3-e38dde7b4a3f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:04.843910 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2563b3c-880c-43ee-89a3-e38dde7b4a3f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:04.844653 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2563b3c-880c-43ee-89a3-e38dde7b4a3f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:04.845133 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a2563b3c-880c-43ee-89a3-e38dde7b4a3f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:04.877905 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a2563b3c-880c-43ee-89a3-e38dde7b4a3f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Going to try to terminate instance {{(pid=124068) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:48:04.936577 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-860fc156-2f6f-4cc6-8974-843cffcaefc6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:04.937599 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-860fc156-2f6f-4cc6-8974-843cffcaefc6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:04.944036 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-860fc156-2f6f-4cc6-8974-843cffcaefc6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:04.944759 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-860fc156-2f6f-4cc6-8974-843cffcaefc6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:04.945814 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-860fc156-2f6f-4cc6-8974-843cffcaefc6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:04.946486 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-860fc156-2f6f-4cc6-8974-843cffcaefc6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:04.968513 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a2563b3c-880c-43ee-89a3-e38dde7b4a3f tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "DELETE /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 204 len: 0 microversion: 2.1 time: 0.135019 Jun 14 19:48:04.972467 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 413/803] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:48:04 2022] DELETE /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:48:04.979986 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-7e1a330e-84a1-4064-a62c-39cdaae899c4 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:04.980691 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-7e1a330e-84a1-4064-a62c-39cdaae899c4 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:04.988289 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7e1a330e-84a1-4064-a62c-39cdaae899c4 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:04.988736 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7e1a330e-84a1-4064-a62c-39cdaae899c4 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:04.989630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7e1a330e-84a1-4064-a62c-39cdaae899c4 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:04.990091 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7e1a330e-84a1-4064-a62c-39cdaae899c4 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:05.127326 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-860fc156-2f6f-4cc6-8974-843cffcaefc6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:05.135369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-860fc156-2f6f-4cc6-8974-843cffcaefc6 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1577 microversion: 2.1 time: 0.202903 Jun 14 19:48:05.135941 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 391/804] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:04 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1577 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:48:05.163935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-7e1a330e-84a1-4064-a62c-39cdaae899c4 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:05.171536 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-7e1a330e-84a1-4064-a62c-39cdaae899c4 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1680 microversion: 2.1 time: 0.197585 Jun 14 19:48:05.172099 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 414/805] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:04 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1680 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:48:05.321114 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2641c50d-2ae4-46f3-87a2-bcf22d021fd4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f11f88a-05f2-46c6-997d-9d9bc56b9029"}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:48:05.322218 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2641c50d-2ae4-46f3-87a2-bcf22d021fd4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:05.328193 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2641c50d-2ae4-46f3-87a2-bcf22d021fd4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:05.328811 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2641c50d-2ae4-46f3-87a2-bcf22d021fd4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:05.329595 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2641c50d-2ae4-46f3-87a2-bcf22d021fd4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:05.330025 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2641c50d-2ae4-46f3-87a2-bcf22d021fd4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:06.152431 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4202a5a3-7478-49cb-b656-893f2bd6db88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:06.153072 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4202a5a3-7478-49cb-b656-893f2bd6db88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:06.159412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4202a5a3-7478-49cb-b656-893f2bd6db88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:06.159867 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4202a5a3-7478-49cb-b656-893f2bd6db88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:06.160630 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4202a5a3-7478-49cb-b656-893f2bd6db88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:06.161068 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4202a5a3-7478-49cb-b656-893f2bd6db88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:06.293552 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4202a5a3-7478-49cb-b656-893f2bd6db88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:06.300941 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4202a5a3-7478-49cb-b656-893f2bd6db88 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1577 microversion: 2.1 time: 0.152518 Jun 14 19:48:06.301513 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 415/806] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:06 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:06.306289 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-7b111236-08a1-4a04-b579-c4cd2a600175 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:06.306886 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-7b111236-08a1-4a04-b579-c4cd2a600175 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:06.312328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7b111236-08a1-4a04-b579-c4cd2a600175 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:06.312770 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7b111236-08a1-4a04-b579-c4cd2a600175 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:06.313543 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7b111236-08a1-4a04-b579-c4cd2a600175 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:06.313975 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7b111236-08a1-4a04-b579-c4cd2a600175 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:06.448008 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-7b111236-08a1-4a04-b579-c4cd2a600175 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:06.456142 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-7b111236-08a1-4a04-b579-c4cd2a600175 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1680 microversion: 2.1 time: 0.153587 Jun 14 19:48:06.456613 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 416/807] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:06 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:06.587200 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2641c50d-2ae4-46f3-87a2-bcf22d021fd4 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "POST /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.269702 Jun 14 19:48:06.587826 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 392/808] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 14 19:48:05 2022] POST /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments => generated 194 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:48:07.025909 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-3838db86-69cc-4ca5-a949-0411fcac5d45 req-69243fbb-1a86-4ae4-93ff-394e4a41724a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0421fa-7df8-4d48-b112-fff79061f5ae", "name": "network-vif-plugged", "status": "completed", "tag": "04d8f989-9542-404e-a49a-add222e0ca49"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:48:07.034565 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-3838db86-69cc-4ca5-a949-0411fcac5d45 req-69243fbb-1a86-4ae4-93ff-394e4a41724a service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:07.035083 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-3838db86-69cc-4ca5-a949-0411fcac5d45 req-69243fbb-1a86-4ae4-93ff-394e4a41724a service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:07.047765 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-3838db86-69cc-4ca5-a949-0411fcac5d45 req-69243fbb-1a86-4ae4-93ff-394e4a41724a service nova] Creating event network-vif-plugged:04d8f989-9542-404e-a49a-add222e0ca49 for instance 2a0421fa-7df8-4d48-b112-fff79061f5ae on hv-cinder-84580 Jun 14 19:48:07.052751 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-3838db86-69cc-4ca5-a949-0411fcac5d45 req-69243fbb-1a86-4ae4-93ff-394e4a41724a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032423 Jun 14 19:48:07.053887 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 417/809] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:48:07.320325 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-910e92ac-04d6-4164-ac5c-63ea1a8af297 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:07.322355 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-910e92ac-04d6-4164-ac5c-63ea1a8af297 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:07.329358 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-910e92ac-04d6-4164-ac5c-63ea1a8af297 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:07.329837 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-910e92ac-04d6-4164-ac5c-63ea1a8af297 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:07.330600 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-910e92ac-04d6-4164-ac5c-63ea1a8af297 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:07.331033 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-910e92ac-04d6-4164-ac5c-63ea1a8af297 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:07.475886 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b63a4fbe-76ae-4cb2-b007-2deae86162e8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:07.477507 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b63a4fbe-76ae-4cb2-b007-2deae86162e8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:07.484124 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b63a4fbe-76ae-4cb2-b007-2deae86162e8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:07.484579 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b63a4fbe-76ae-4cb2-b007-2deae86162e8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:07.485551 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b63a4fbe-76ae-4cb2-b007-2deae86162e8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:07.485993 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b63a4fbe-76ae-4cb2-b007-2deae86162e8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:07.487313 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-910e92ac-04d6-4164-ac5c-63ea1a8af297 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:07.497033 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-910e92ac-04d6-4164-ac5c-63ea1a8af297 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1577 microversion: 2.1 time: 0.180533 Jun 14 19:48:07.498310 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 393/810] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:07 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:07.578013 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b63a4fbe-76ae-4cb2-b007-2deae86162e8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:07.585838 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b63a4fbe-76ae-4cb2-b007-2deae86162e8 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1612 microversion: 2.1 time: 0.114727 Jun 14 19:48:07.586491 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 418/811] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:07 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1612 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:48:08.004318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-db9f68fc-933f-45bc-bafc-d26cf67aa55e req-9ccbf969-92d7-4af5-ae79-eb8b2b81f105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906a717b-f3cc-4340-b6b6-7c47ef2ac058", "name": "network-vif-deleted", "tag": "53b179df-e11d-45d1-a96c-7a7732926650"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:48:08.013146 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-db9f68fc-933f-45bc-bafc-d26cf67aa55e req-9ccbf969-92d7-4af5-ae79-eb8b2b81f105 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:08.013951 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-db9f68fc-933f-45bc-bafc-d26cf67aa55e req-9ccbf969-92d7-4af5-ae79-eb8b2b81f105 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:08.018253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:08.027943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-db9f68fc-933f-45bc-bafc-d26cf67aa55e req-9ccbf969-92d7-4af5-ae79-eb8b2b81f105 service nova] Creating event network-vif-deleted:53b179df-e11d-45d1-a96c-7a7732926650 for instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 on hv-cinder-84580 Jun 14 19:48:08.033043 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-db9f68fc-933f-45bc-bafc-d26cf67aa55e req-9ccbf969-92d7-4af5-ae79-eb8b2b81f105 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032372 Jun 14 19:48:08.034071 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 394/812] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:48:08.514979 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f0848cd6-a36f-4657-a92d-3f8ab9b48565 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:08.515896 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f0848cd6-a36f-4657-a92d-3f8ab9b48565 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:08.523330 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f0848cd6-a36f-4657-a92d-3f8ab9b48565 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:08.524714 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f0848cd6-a36f-4657-a92d-3f8ab9b48565 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:08.525474 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f0848cd6-a36f-4657-a92d-3f8ab9b48565 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:08.526139 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f0848cd6-a36f-4657-a92d-3f8ab9b48565 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:08.603810 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8407d897-f824-4224-8fd5-62023928cf2d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:08.604598 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8407d897-f824-4224-8fd5-62023928cf2d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:08.612484 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8407d897-f824-4224-8fd5-62023928cf2d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:08.612942 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8407d897-f824-4224-8fd5-62023928cf2d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:08.613938 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8407d897-f824-4224-8fd5-62023928cf2d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:08.614657 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8407d897-f824-4224-8fd5-62023928cf2d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:08.696139 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-f0848cd6-a36f-4657-a92d-3f8ab9b48565 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:08.700716 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8407d897-f824-4224-8fd5-62023928cf2d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:08.701488 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8407d897-f824-4224-8fd5-62023928cf2d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:08.702170 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.objects.instance [None req-8407d897-f824-4224-8fd5-62023928cf2d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lazy-loading 'fault' on Instance uuid 906a717b-f3cc-4340-b6b6-7c47ef2ac058 {{(pid=124069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:48:08.706107 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f0848cd6-a36f-4657-a92d-3f8ab9b48565 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1577 microversion: 2.1 time: 0.194892 Jun 14 19:48:08.708857 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 419/813] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:08 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1577 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:08.763052 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8407d897-f824-4224-8fd5-62023928cf2d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323c51f037db4ecca2f66cb6e9879246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:08.770823 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8407d897-f824-4224-8fd5-62023928cf2d tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 200 len: 1331 microversion: 2.1 time: 0.172023 Jun 14 19:48:08.771409 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 395/814] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:08 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 1331 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:09.723580 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3f19f5cf-f96a-4255-9b8a-31430e4eef86 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:09.724230 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3f19f5cf-f96a-4255-9b8a-31430e4eef86 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:09.731247 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3f19f5cf-f96a-4255-9b8a-31430e4eef86 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:09.731794 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3f19f5cf-f96a-4255-9b8a-31430e4eef86 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:09.732592 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3f19f5cf-f96a-4255-9b8a-31430e4eef86 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:09.733020 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3f19f5cf-f96a-4255-9b8a-31430e4eef86 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:09.789399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-331fa736-4dbd-4024-b369-bb8ea4df2932 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:09.790903 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-331fa736-4dbd-4024-b369-bb8ea4df2932 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:09.802921 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-331fa736-4dbd-4024-b369-bb8ea4df2932 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:09.803606 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-331fa736-4dbd-4024-b369-bb8ea4df2932 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:09.804594 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-331fa736-4dbd-4024-b369-bb8ea4df2932 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:09.805101 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-331fa736-4dbd-4024-b369-bb8ea4df2932 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:09.828419 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-331fa736-4dbd-4024-b369-bb8ea4df2932 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] HTTP exception thrown: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-331fa736-4dbd-4024-b369-bb8ea4df2932 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Request method failure captured: Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 HTTP/1.1 Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSSLZpR2w_xFmfjar75tGJDU2sD62hg-I9tSk--QtfqjFSlliGkRH_W6CYwZ7Iph2aF4fxrjxzyeJzd_hl0QyZ4Pw-2UckaxY5_2H0QoR9Blg4BQM7Y5TpsnBrEMi60m5uD-Uzx7H-VX8XJXxLhIjXrvmJpguoa2gF4eYzoPZCLZyc Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:48:09.830245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:48:09.831836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}] Jun 14 19:48:09.831836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:09.831836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:09.831836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:09.831836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:09.831836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:48:09.831836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:48:09.831836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 323c51f037db4ecca2f66cb6e9879246 Jun 14 19:48:09.831836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:09.831836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:48:09.831836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. Jun 14 19:48:09.831836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '906a717b-f3cc-4340-b6b6-7c47ef2ac058'} Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:48:09.832804 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. Jun 14 19:48:09.834405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:09.836639 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-331fa736-4dbd-4024-b369-bb8ea4df2932 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Returning 404 to user: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:48:09.836639 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-331fa736-4dbd-4024-b369-bb8ea4df2932 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 404 len: 111 microversion: 2.1 time: 0.046275 Jun 14 19:48:09.836639 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 396/815] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:09 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:48:09.841976 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-eead03a4-7621-4ab4-87c9-389e37a2a170 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '.version_select at 0x7f144b462550>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:09.859697 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-eead03a4-7621-4ab4-87c9-389e37a2a170 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-448417111" status: 202 len: 0 microversion: 2.1 time: 0.021553 Jun 14 19:48:09.860348 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 397/816] 10.222.0.44 () {58 vars in 1217 bytes} [Tue Jun 14 19:48:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-448417111 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:48:09.875790 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3f19f5cf-f96a-4255-9b8a-31430e4eef86 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:09.885329 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3f19f5cf-f96a-4255-9b8a-31430e4eef86 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1564 microversion: 2.1 time: 0.165536 Jun 14 19:48:09.886060 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 420/817] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:09 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:11.616406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-927e5de8-3e8d-40d5-b94f-f5bb01d98816 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:11.616909 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-927e5de8-3e8d-40d5-b94f-f5bb01d98816 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:11.623651 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-927e5de8-3e8d-40d5-b94f-f5bb01d98816 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:11.624088 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-927e5de8-3e8d-40d5-b94f-f5bb01d98816 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:11.624832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-927e5de8-3e8d-40d5-b94f-f5bb01d98816 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:11.625257 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-927e5de8-3e8d-40d5-b94f-f5bb01d98816 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:11.637907 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-927e5de8-3e8d-40d5-b94f-f5bb01d98816 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] HTTP exception thrown: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-927e5de8-3e8d-40d5-b94f-f5bb01d98816 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Request method failure captured: Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: DELETE /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 HTTP/1.1 Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSSLZpR2w_xFmfjar75tGJDU2sD62hg-I9tSk--QtfqjFSlliGkRH_W6CYwZ7Iph2aF4fxrjxzyeJzd_hl0QyZ4Pw-2UckaxY5_2H0QoR9Blg4BQM7Y5TpsnBrEMi60m5uD-Uzx7H-VX8XJXxLhIjXrvmJpguoa2gF4eYzoPZCLZyc Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:48:11.639439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:48:11.640686 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}] Jun 14 19:48:11.640686 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:11.640686 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:11.640686 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:11.640686 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:11.640686 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:48:11.640686 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:48:11.640686 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 323c51f037db4ecca2f66cb6e9879246 Jun 14 19:48:11.640686 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:11.640686 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:48:11.640686 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. Jun 14 19:48:11.640686 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '906a717b-f3cc-4340-b6b6-7c47ef2ac058'} Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:48:11.641440 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. Jun 14 19:48:11.642597 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:11.644009 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-927e5de8-3e8d-40d5-b94f-f5bb01d98816 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Returning 404 to user: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:48:11.644009 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-927e5de8-3e8d-40d5-b94f-f5bb01d98816 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "DELETE /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 404 len: 111 microversion: 2.1 time: 0.028867 Jun 14 19:48:11.644009 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 398/818] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:48:11 2022] DELETE /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:48:11.649684 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-be6d6210-44bd-4da2-ad4d-9f3c5c6cef36 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:11.650270 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-be6d6210-44bd-4da2-ad4d-9f3c5c6cef36 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 906a717b-f3cc-4340-b6b6-7c47ef2ac058] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:11.652825 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:11.658244 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-be6d6210-44bd-4da2-ad4d-9f3c5c6cef36 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:11.658688 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-be6d6210-44bd-4da2-ad4d-9f3c5c6cef36 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:11.659470 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-be6d6210-44bd-4da2-ad4d-9f3c5c6cef36 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:11.659893 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-be6d6210-44bd-4da2-ad4d-9f3c5c6cef36 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:11.674152 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-be6d6210-44bd-4da2-ad4d-9f3c5c6cef36 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] HTTP exception thrown: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-be6d6210-44bd-4da2-ad4d-9f3c5c6cef36 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Request method failure captured: Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 HTTP/1.1 Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOSSLZpR2w_xFmfjar75tGJDU2sD62hg-I9tSk--QtfqjFSlliGkRH_W6CYwZ7Iph2aF4fxrjxzyeJzd_hl0QyZ4Pw-2UckaxY5_2H0QoR9Blg4BQM7Y5TpsnBrEMi60m5uD-Uzx7H-VX8XJXxLhIjXrvmJpguoa2gF4eYzoPZCLZyc Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:48:11.675749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:48:11.677516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}] Jun 14 19:48:11.677516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:11.677516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:11.677516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:11.677516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:11.677516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:48:11.677516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:48:11.677516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 323c51f037db4ecca2f66cb6e9879246 Jun 14 19:48:11.677516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:11.677516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:48:11.677516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. Jun 14 19:48:11.677516 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': '906a717b-f3cc-4340-b6b6-7c47ef2ac058'} Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:48:11.678649 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. Jun 14 19:48:11.680231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:11.681683 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-be6d6210-44bd-4da2-ad4d-9f3c5c6cef36 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Returning 404 to user: Instance 906a717b-f3cc-4340-b6b6-7c47ef2ac058 could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:48:11.681683 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-be6d6210-44bd-4da2-ad4d-9f3c5c6cef36 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058" status: 404 len: 111 microversion: 2.1 time: 0.031957 Jun 14 19:48:11.681683 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 421/819] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:11 2022] GET /compute/v2.1/servers/906a717b-f3cc-4340-b6b6-7c47ef2ac058 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:48:12.814209 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-dfa4faf8-602b-4384-bcdf-ba469e494520 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:12.814894 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-dfa4faf8-602b-4384-bcdf-ba469e494520 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:12.821462 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dfa4faf8-602b-4384-bcdf-ba469e494520 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:12.821906 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dfa4faf8-602b-4384-bcdf-ba469e494520 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:12.822658 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dfa4faf8-602b-4384-bcdf-ba469e494520 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:12.823082 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dfa4faf8-602b-4384-bcdf-ba469e494520 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:12.836503 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-dfa4faf8-602b-4384-bcdf-ba469e494520 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] HTTP exception thrown: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-dfa4faf8-602b-4384-bcdf-ba469e494520 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Request method failure captured: Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: DELETE /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a HTTP/1.1 Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSSLZpR2w_xFmfjar75tGJDU2sD62hg-I9tSk--QtfqjFSlliGkRH_W6CYwZ7Iph2aF4fxrjxzyeJzd_hl0QyZ4Pw-2UckaxY5_2H0QoR9Blg4BQM7Y5TpsnBrEMi60m5uD-Uzx7H-VX8XJXxLhIjXrvmJpguoa2gF4eYzoPZCLZyc Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:48:12.838038 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:48:12.839608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}] Jun 14 19:48:12.839608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:12.839608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:12.839608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:12.839608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:12.839608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:48:12.839608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:48:12.839608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 323c51f037db4ecca2f66cb6e9879246 Jun 14 19:48:12.839608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:12.839608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:48:12.839608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. Jun 14 19:48:12.839608 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': 'c5bae0a1-ab48-4943-95c1-bf124010357a'} Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:48:12.840501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. Jun 14 19:48:12.842001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.843555 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-dfa4faf8-602b-4384-bcdf-ba469e494520 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Returning 404 to user: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:48:12.843555 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-dfa4faf8-602b-4384-bcdf-ba469e494520 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 404 len: 111 microversion: 2.1 time: 0.029093 Jun 14 19:48:12.843555 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 399/820] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:48:12 2022] DELETE /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:48:12.848688 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-8d772228-b08f-4707-a65e-d62e75a10f18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:12.849472 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8d772228-b08f-4707-a65e-d62e75a10f18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: c5bae0a1-ab48-4943-95c1-bf124010357a] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:12.856468 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8d772228-b08f-4707-a65e-d62e75a10f18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:12.856902 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8d772228-b08f-4707-a65e-d62e75a10f18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:12.857680 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8d772228-b08f-4707-a65e-d62e75a10f18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:12.858111 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8d772228-b08f-4707-a65e-d62e75a10f18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:12.872202 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-8d772228-b08f-4707-a65e-d62e75a10f18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] HTTP exception thrown: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-8d772228-b08f-4707-a65e-d62e75a10f18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Request method failure captured: Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a HTTP/1.1 Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOSSLZpR2w_xFmfjar75tGJDU2sD62hg-I9tSk--QtfqjFSlliGkRH_W6CYwZ7Iph2aF4fxrjxzyeJzd_hl0QyZ4Pw-2UckaxY5_2H0QoR9Blg4BQM7Y5TpsnBrEMi60m5uD-Uzx7H-VX8XJXxLhIjXrvmJpguoa2gF4eYzoPZCLZyc Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:48:12.873749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:48:12.875292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}] Jun 14 19:48:12.875292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:12.875292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:12.875292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:12.875292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:12.875292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:48:12.875292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:48:12.875292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 323c51f037db4ecca2f66cb6e9879246 Jun 14 19:48:12.875292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:12.875292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:48:12.875292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. Jun 14 19:48:12.875292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': 'c5bae0a1-ab48-4943-95c1-bf124010357a'} Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:48:12.876154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. Jun 14 19:48:12.877590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.879037 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-8d772228-b08f-4707-a65e-d62e75a10f18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Returning 404 to user: Instance c5bae0a1-ab48-4943-95c1-bf124010357a could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:48:12.879037 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-8d772228-b08f-4707-a65e-d62e75a10f18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a" status: 404 len: 111 microversion: 2.1 time: 0.030228 Jun 14 19:48:12.879037 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 422/821] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:12 2022] GET /compute/v2.1/servers/c5bae0a1-ab48-4943-95c1-bf124010357a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:48:12.883414 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-81b80d25-85df-41b1-bdd1-1374e762f6ab tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:12.884508 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-81b80d25-85df-41b1-bdd1-1374e762f6ab tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:12.890469 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-81b80d25-85df-41b1-bdd1-1374e762f6ab tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:12.890910 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-81b80d25-85df-41b1-bdd1-1374e762f6ab tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:12.891659 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-81b80d25-85df-41b1-bdd1-1374e762f6ab tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:12.892084 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-81b80d25-85df-41b1-bdd1-1374e762f6ab tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:12.905456 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-81b80d25-85df-41b1-bdd1-1374e762f6ab tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] HTTP exception thrown: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-81b80d25-85df-41b1-bdd1-1374e762f6ab tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Request method failure captured: Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: DELETE /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 HTTP/1.1 Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSSLZpR2w_xFmfjar75tGJDU2sD62hg-I9tSk--QtfqjFSlliGkRH_W6CYwZ7Iph2aF4fxrjxzyeJzd_hl0QyZ4Pw-2UckaxY5_2H0QoR9Blg4BQM7Y5TpsnBrEMi60m5uD-Uzx7H-VX8XJXxLhIjXrvmJpguoa2gF4eYzoPZCLZyc Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:48:12.906958 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:48:12.908502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}] Jun 14 19:48:12.908502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:12.908502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:12.908502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:12.908502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:12.908502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:48:12.908502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:48:12.908502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 323c51f037db4ecca2f66cb6e9879246 Jun 14 19:48:12.908502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:12.908502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:48:12.908502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. Jun 14 19:48:12.908502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '4e2353fc-c6c0-4c56-8423-5bc7b343acc7'} Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:48:12.909349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. Jun 14 19:48:12.910865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.912315 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-81b80d25-85df-41b1-bdd1-1374e762f6ab tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Returning 404 to user: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:48:12.912315 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-81b80d25-85df-41b1-bdd1-1374e762f6ab tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 404 len: 111 microversion: 2.1 time: 0.029262 Jun 14 19:48:12.912315 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 400/822] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:48:12 2022] DELETE /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:48:12.917928 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9763ab93-acb8-489c-9018-490b5fde86a5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:12.918546 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9763ab93-acb8-489c-9018-490b5fde86a5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: 4e2353fc-c6c0-4c56-8423-5bc7b343acc7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:12.924454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9763ab93-acb8-489c-9018-490b5fde86a5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:12.924906 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9763ab93-acb8-489c-9018-490b5fde86a5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:12.925695 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9763ab93-acb8-489c-9018-490b5fde86a5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:12.926136 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9763ab93-acb8-489c-9018-490b5fde86a5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:12.940963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-9763ab93-acb8-489c-9018-490b5fde86a5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] HTTP exception thrown: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9763ab93-acb8-489c-9018-490b5fde86a5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Request method failure captured: Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 HTTP/1.1 Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOSSLZpR2w_xFmfjar75tGJDU2sD62hg-I9tSk--QtfqjFSlliGkRH_W6CYwZ7Iph2aF4fxrjxzyeJzd_hl0QyZ4Pw-2UckaxY5_2H0QoR9Blg4BQM7Y5TpsnBrEMi60m5uD-Uzx7H-VX8XJXxLhIjXrvmJpguoa2gF4eYzoPZCLZyc Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:48:12.942537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:48:12.944067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}] Jun 14 19:48:12.944067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:12.944067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:12.944067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:12.944067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:12.944067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:48:12.944067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:48:12.944067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 323c51f037db4ecca2f66cb6e9879246 Jun 14 19:48:12.944067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:12.944067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:48:12.944067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. Jun 14 19:48:12.944067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': '4e2353fc-c6c0-4c56-8423-5bc7b343acc7'} Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:48:12.944916 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. Jun 14 19:48:12.946351 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:12.947595 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9763ab93-acb8-489c-9018-490b5fde86a5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Returning 404 to user: Instance 4e2353fc-c6c0-4c56-8423-5bc7b343acc7 could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:48:12.947595 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9763ab93-acb8-489c-9018-490b5fde86a5 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7" status: 404 len: 111 microversion: 2.1 time: 0.030395 Jun 14 19:48:12.947595 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 423/823] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:12 2022] GET /compute/v2.1/servers/4e2353fc-c6c0-4c56-8423-5bc7b343acc7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:48:14.079809 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-533f1c35-c839-4632-bda5-8fa6e08cff18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:14.080304 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-533f1c35-c839-4632-bda5-8fa6e08cff18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:14.086814 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-533f1c35-c839-4632-bda5-8fa6e08cff18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:14.087256 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-533f1c35-c839-4632-bda5-8fa6e08cff18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:14.088017 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-533f1c35-c839-4632-bda5-8fa6e08cff18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:14.088448 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-533f1c35-c839-4632-bda5-8fa6e08cff18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:14.104137 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-00958920-1562-4c96-ae69-ae4f22b6b91c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:14.104668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-533f1c35-c839-4632-bda5-8fa6e08cff18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] HTTP exception thrown: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. Jun 14 19:48:14.105061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-00958920-1562-4c96-ae69-ae4f22b6b91c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-533f1c35-c839-4632-bda5-8fa6e08cff18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Request method failure captured: Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: DELETE /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 HTTP/1.1 Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSSLZpR2w_xFmfjar75tGJDU2sD62hg-I9tSk--QtfqjFSlliGkRH_W6CYwZ7Iph2aF4fxrjxzyeJzd_hl0QyZ4Pw-2UckaxY5_2H0QoR9Blg4BQM7Y5TpsnBrEMi60m5uD-Uzx7H-VX8XJXxLhIjXrvmJpguoa2gF4eYzoPZCLZyc Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:48:14.105752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:48:14.107207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}] Jun 14 19:48:14.107207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:14.107207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:14.107207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:14.107207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:14.107207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:48:14.107207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:48:14.107207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 323c51f037db4ecca2f66cb6e9879246 Jun 14 19:48:14.107207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:14.107207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:48:14.107207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. Jun 14 19:48:14.107207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': 'f1434a82-cdbc-474b-95c4-44331ae4a084'} Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:48:14.107920 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. Jun 14 19:48:14.109152 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:14.110374 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-533f1c35-c839-4632-bda5-8fa6e08cff18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Returning 404 to user: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:48:14.110374 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-533f1c35-c839-4632-bda5-8fa6e08cff18 tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 404 len: 111 microversion: 2.1 time: 0.031222 Jun 14 19:48:14.110374 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 401/824] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:48:14 2022] DELETE /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:48:14.111794 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-00958920-1562-4c96-ae69-ae4f22b6b91c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:14.112889 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-00958920-1562-4c96-ae69-ae4f22b6b91c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:14.113688 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-00958920-1562-4c96-ae69-ae4f22b6b91c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:14.114131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-00958920-1562-4c96-ae69-ae4f22b6b91c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:14.115593 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-09fda505-8212-4fbc-a7aa-eb494d07de9a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:14.116375 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-09fda505-8212-4fbc-a7aa-eb494d07de9a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] [instance: f1434a82-cdbc-474b-95c4-44331ae4a084] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:14.123028 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-09fda505-8212-4fbc-a7aa-eb494d07de9a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:14.123481 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-09fda505-8212-4fbc-a7aa-eb494d07de9a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:14.124286 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-09fda505-8212-4fbc-a7aa-eb494d07de9a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:14.124720 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-09fda505-8212-4fbc-a7aa-eb494d07de9a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:14.139026 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-09fda505-8212-4fbc-a7aa-eb494d07de9a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] HTTP exception thrown: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-09fda505-8212-4fbc-a7aa-eb494d07de9a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Request method failure captured: Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 HTTP/1.1 Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSSLZpR2w_xFmfjar75tGJDU2sD62hg-I9tSk--QtfqjFSlliGkRH_W6CYwZ7Iph2aF4fxrjxzyeJzd_hl0QyZ4Pw-2UckaxY5_2H0QoR9Blg4BQM7Y5TpsnBrEMi60m5uD-Uzx7H-VX8XJXxLhIjXrvmJpguoa2gF4eYzoPZCLZyc Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:48:14.140548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:48:14.142074 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b2b0a8b4f1e44e2da0750dd3f12fbb18"}]}] Jun 14 19:48:14.142074 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:14.142074 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: b2b0a8b4f1e44e2da0750dd3f12fbb18 Jun 14 19:48:14.142074 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-547494806 Jun 14 19:48:14.142074 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:14.142074 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:48:14.142074 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:48:14.142074 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 323c51f037db4ecca2f66cb6e9879246 Jun 14 19:48:14.142074 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeNegativeTest-547494806-project Jun 14 19:48:14.142074 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:48:14.142074 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. Jun 14 19:48:14.142074 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': 'f1434a82-cdbc-474b-95c4-44331ae4a084'} Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:48:14.142845 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. Jun 14 19:48:14.144357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:14.145650 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-09fda505-8212-4fbc-a7aa-eb494d07de9a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] Returning 404 to user: Instance f1434a82-cdbc-474b-95c4-44331ae4a084 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:48:14.145650 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-09fda505-8212-4fbc-a7aa-eb494d07de9a tempest-AttachVolumeNegativeTest-547494806 tempest-AttachVolumeNegativeTest-547494806-project] 10.222.0.44 "GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084" status: 404 len: 111 microversion: 2.1 time: 0.029960 Jun 14 19:48:14.145650 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 402/825] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:14 2022] GET /compute/v2.1/servers/f1434a82-cdbc-474b-95c4-44331ae4a084 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:48:14.146771 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-00958920-1562-4c96-ae69-ae4f22b6b91c tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045871 Jun 14 19:48:14.147616 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 424/826] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:48:14 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:48:14.295363 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-f31bab8c-4140-43fd-a46d-9e47db2f1008 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:14.295854 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-f31bab8c-4140-43fd-a46d-9e47db2f1008 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:14.301818 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f31bab8c-4140-43fd-a46d-9e47db2f1008 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:14.302270 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f31bab8c-4140-43fd-a46d-9e47db2f1008 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:14.303026 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f31bab8c-4140-43fd-a46d-9e47db2f1008 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:14.303458 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f31bab8c-4140-43fd-a46d-9e47db2f1008 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:14.333509 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-f31bab8c-4140-43fd-a46d-9e47db2f1008 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments/add3b722-89f0-4233-b393-d8791eb0ae10" status: 200 len: 194 microversion: 2.1 time: 0.041999 Jun 14 19:48:14.334300 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 403/827] 10.222.0.44 () {58 vars in 1412 bytes} [Tue Jun 14 19:48:14 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments/add3b722-89f0-4233-b393-d8791eb0ae10 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:48:14.344467 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f52dc103-cd5a-40f4-bdf1-e3d9c68dcced tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:14.345115 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f52dc103-cd5a-40f4-bdf1-e3d9c68dcced tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:14.351711 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f52dc103-cd5a-40f4-bdf1-e3d9c68dcced tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:14.352148 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f52dc103-cd5a-40f4-bdf1-e3d9c68dcced tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:14.352922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f52dc103-cd5a-40f4-bdf1-e3d9c68dcced tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:14.353363 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f52dc103-cd5a-40f4-bdf1-e3d9c68dcced tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:14.437046 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.objects.instance [None req-f52dc103-cd5a-40f4-bdf1-e3d9c68dcced tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lazy-loading 'services' on Instance uuid 55328760-5eb8-4c2b-bed1-b75b972100a7 {{(pid=124068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:48:14.509818 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f52dc103-cd5a-40f4-bdf1-e3d9c68dcced tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments/add3b722-89f0-4233-b393-d8791eb0ae10" status: 202 len: 0 microversion: 2.1 time: 0.169652 Jun 14 19:48:14.510639 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 425/828] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 14 19:48:14 2022] DELETE /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments/add3b722-89f0-4233-b393-d8791eb0ae10 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:48:16.685653 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6beba4cd-128d-4d92-ac18-5252abef3834 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:16.686213 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-6beba4cd-128d-4d92-ac18-5252abef3834 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:16.692998 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6beba4cd-128d-4d92-ac18-5252abef3834 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:16.693551 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6beba4cd-128d-4d92-ac18-5252abef3834 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:16.694368 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6beba4cd-128d-4d92-ac18-5252abef3834 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:16.694919 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6beba4cd-128d-4d92-ac18-5252abef3834 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:16.724428 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6beba4cd-128d-4d92-ac18-5252abef3834 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments/3f11f88a-05f2-46c6-997d-9d9bc56b9029" status: 200 len: 194 microversion: 2.1 time: 0.042855 Jun 14 19:48:16.730253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 404/829] 10.222.0.44 () {58 vars in 1412 bytes} [Tue Jun 14 19:48:16 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments/3f11f88a-05f2-46c6-997d-9d9bc56b9029 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:48:16.736954 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e1db0f78-4881-4bd9-b99e-f532414e6036 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:16.737738 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e1db0f78-4881-4bd9-b99e-f532414e6036 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:16.744091 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e1db0f78-4881-4bd9-b99e-f532414e6036 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:16.744634 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e1db0f78-4881-4bd9-b99e-f532414e6036 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:16.745503 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e1db0f78-4881-4bd9-b99e-f532414e6036 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:16.745998 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e1db0f78-4881-4bd9-b99e-f532414e6036 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:16.830496 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.objects.instance [None req-e1db0f78-4881-4bd9-b99e-f532414e6036 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lazy-loading 'services' on Instance uuid 55328760-5eb8-4c2b-bed1-b75b972100a7 {{(pid=124068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:48:16.920570 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e1db0f78-4881-4bd9-b99e-f532414e6036 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments/3f11f88a-05f2-46c6-997d-9d9bc56b9029" status: 202 len: 0 microversion: 2.1 time: 0.187019 Jun 14 19:48:16.922365 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 426/830] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 14 19:48:16 2022] DELETE /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments/3f11f88a-05f2-46c6-997d-9d9bc56b9029 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:48:17.550576 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a82e619a-365f-4e0e-8a3c-c2c85c46b426 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "189bb7d2-d059-4d8a-917d-b5ef3c8b2e4c", "device": "/dev/sdb"}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:48:17.552261 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a82e619a-365f-4e0e-8a3c-c2c85c46b426 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:17.559436 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a82e619a-365f-4e0e-8a3c-c2c85c46b426 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:17.559898 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a82e619a-365f-4e0e-8a3c-c2c85c46b426 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:17.560680 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a82e619a-365f-4e0e-8a3c-c2c85c46b426 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:17.561120 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a82e619a-365f-4e0e-8a3c-c2c85c46b426 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:17.842191 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a82e619a-365f-4e0e-8a3c-c2c85c46b426 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "POST /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296898 Jun 14 19:48:17.845417 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 405/831] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 14 19:48:17 2022] POST /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:48:18.115781 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c69ffcab-b4a6-4f05-b505-d2915ceb04b7 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:18.117353 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c69ffcab-b4a6-4f05-b505-d2915ceb04b7 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:18.124624 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c69ffcab-b4a6-4f05-b505-d2915ceb04b7 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:18.125074 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c69ffcab-b4a6-4f05-b505-d2915ceb04b7 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:18.126172 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c69ffcab-b4a6-4f05-b505-d2915ceb04b7 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:18.126612 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c69ffcab-b4a6-4f05-b505-d2915ceb04b7 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:18.158201 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c69ffcab-b4a6-4f05-b505-d2915ceb04b7 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046526 Jun 14 19:48:18.161701 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 427/832] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:48:18 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 19:48:18.272558 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-3fa4d72e-4703-42b9-a853-1c797ae7a8f8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:18.274224 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-3fa4d72e-4703-42b9-a853-1c797ae7a8f8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:18.281620 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3fa4d72e-4703-42b9-a853-1c797ae7a8f8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:18.282061 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3fa4d72e-4703-42b9-a853-1c797ae7a8f8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:18.282826 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3fa4d72e-4703-42b9-a853-1c797ae7a8f8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:18.283257 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3fa4d72e-4703-42b9-a853-1c797ae7a8f8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:18.313584 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-3fa4d72e-4703-42b9-a853-1c797ae7a8f8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045397 Jun 14 19:48:18.314134 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 406/833] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:48:18 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 19:48:18.374314 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d98600a0-965f-4145-8db7-83da77516b33 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:18.374892 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d98600a0-965f-4145-8db7-83da77516b33 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:18.381172 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d98600a0-965f-4145-8db7-83da77516b33 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:18.381718 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d98600a0-965f-4145-8db7-83da77516b33 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:18.383691 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d98600a0-965f-4145-8db7-83da77516b33 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:18.384129 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d98600a0-965f-4145-8db7-83da77516b33 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:18.410171 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d98600a0-965f-4145-8db7-83da77516b33 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Going to try to terminate instance {{(pid=124068) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:48:18.416608 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:18.492640 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d98600a0-965f-4145-8db7-83da77516b33 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 204 len: 0 microversion: 2.1 time: 0.121379 Jun 14 19:48:18.493262 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 428/834] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:48:18 2022] DELETE /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:48:18.501277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4c1696f8-d802-4aa7-b635-30e9a59cb987 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:18.502185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4c1696f8-d802-4aa7-b635-30e9a59cb987 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:18.509785 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4c1696f8-d802-4aa7-b635-30e9a59cb987 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:18.510306 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4c1696f8-d802-4aa7-b635-30e9a59cb987 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:18.511140 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4c1696f8-d802-4aa7-b635-30e9a59cb987 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:18.511645 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4c1696f8-d802-4aa7-b635-30e9a59cb987 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:18.647826 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4c1696f8-d802-4aa7-b635-30e9a59cb987 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:18.655451 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4c1696f8-d802-4aa7-b635-30e9a59cb987 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1674 microversion: 2.1 time: 0.158055 Jun 14 19:48:18.656211 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 407/835] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:18 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:19.674300 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-695acf1b-731a-4444-a8ee-7c483f41a3f8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:19.675207 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-695acf1b-731a-4444-a8ee-7c483f41a3f8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:19.682669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-695acf1b-731a-4444-a8ee-7c483f41a3f8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:19.683200 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-695acf1b-731a-4444-a8ee-7c483f41a3f8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:19.684079 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-695acf1b-731a-4444-a8ee-7c483f41a3f8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:19.684514 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-695acf1b-731a-4444-a8ee-7c483f41a3f8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:19.853154 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-695acf1b-731a-4444-a8ee-7c483f41a3f8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:19.860692 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-695acf1b-731a-4444-a8ee-7c483f41a3f8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1674 microversion: 2.1 time: 0.190965 Jun 14 19:48:19.861290 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 429/836] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:19 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1674 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:20.878392 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-db99714b-90e0-46c6-8f10-052fe14a5219 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:20.879011 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-db99714b-90e0-46c6-8f10-052fe14a5219 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:20.886315 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-db99714b-90e0-46c6-8f10-052fe14a5219 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:20.886776 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-db99714b-90e0-46c6-8f10-052fe14a5219 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:20.887737 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-db99714b-90e0-46c6-8f10-052fe14a5219 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:20.888176 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-db99714b-90e0-46c6-8f10-052fe14a5219 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:21.047177 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-db99714b-90e0-46c6-8f10-052fe14a5219 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18261f10678a4ce99626794c39bb5d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa8aab8447434b8619c3b7bb0b585a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:21.064168 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-db99714b-90e0-46c6-8f10-052fe14a5219 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 200 len: 1674 microversion: 2.1 time: 0.189468 Jun 14 19:48:21.065836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 408/837] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:20 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 1674 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:21.346422 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-9f2c0e62-e09a-4389-8ea9-48a25f2bb012 req-ef5fe9e9-01ae-417c-acfc-8c4744c9ff06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55328760-5eb8-4c2b-bed1-b75b972100a7", "name": "network-vif-deleted", "tag": "89baf037-10a7-4dc8-9634-4882cccec5be"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:48:21.362053 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-9f2c0e62-e09a-4389-8ea9-48a25f2bb012 req-ef5fe9e9-01ae-417c-acfc-8c4744c9ff06 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:21.362698 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-9f2c0e62-e09a-4389-8ea9-48a25f2bb012 req-ef5fe9e9-01ae-417c-acfc-8c4744c9ff06 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:21.374741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-9f2c0e62-e09a-4389-8ea9-48a25f2bb012 req-ef5fe9e9-01ae-417c-acfc-8c4744c9ff06 service nova] Creating event network-vif-deleted:89baf037-10a7-4dc8-9634-4882cccec5be for instance 55328760-5eb8-4c2b-bed1-b75b972100a7 on hv-cinder-84580 Jun 14 19:48:21.380171 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-9f2c0e62-e09a-4389-8ea9-48a25f2bb012 req-ef5fe9e9-01ae-417c-acfc-8c4744c9ff06 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040281 Jun 14 19:48:21.381218 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 430/838] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:48:22.082199 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-cc5ed793-a517-44cb-ab1b-64a8c6fbbca8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:22.082810 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-cc5ed793-a517-44cb-ab1b-64a8c6fbbca8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:22.092511 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cc5ed793-a517-44cb-ab1b-64a8c6fbbca8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:22.093711 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cc5ed793-a517-44cb-ab1b-64a8c6fbbca8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:22.094667 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cc5ed793-a517-44cb-ab1b-64a8c6fbbca8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:22.095259 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cc5ed793-a517-44cb-ab1b-64a8c6fbbca8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:22.112091 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-cc5ed793-a517-44cb-ab1b-64a8c6fbbca8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] HTTP exception thrown: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-cc5ed793-a517-44cb-ab1b-64a8c6fbbca8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Request method failure captured: Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 HTTP/1.1 Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSU6jdf10-DjmYngwGNTGvxjJRWPyC6wno2zEwQBLtN3rsIaP6a83KjWJ2eEIEENFajV9OR0kxR8PY7ebZx2v8ZG5Gr_0T-BD99J6FCbhRE3UFARQrnTpmRPHub0_6quHGwF_vPrL5Q91pvvvRBb_-WMhzCg_dG8m52-AbYYa2CXEM Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: f4aa8aab8447434b8619c3b7bb0b585a Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:48:22.113792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:48:22.115471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4aa8aab8447434b8619c3b7bb0b585a"}]}] Jun 14 19:48:22.115471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:48:22.115471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: f4aa8aab8447434b8619c3b7bb0b585a Jun 14 19:48:22.115471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:48:22.115471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeTestJSON-60739376-project Jun 14 19:48:22.115471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:48:22.115471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:48:22.115471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 18261f10678a4ce99626794c39bb5d7f Jun 14 19:48:22.115471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeTestJSON-60739376-project Jun 14 19:48:22.115471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:48:22.115471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. Jun 14 19:48:22.115471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '55328760-5eb8-4c2b-bed1-b75b972100a7'} Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:48:22.116916 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. Jun 14 19:48:22.118328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:22.119594 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-cc5ed793-a517-44cb-ab1b-64a8c6fbbca8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Returning 404 to user: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:48:22.119594 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-cc5ed793-a517-44cb-ab1b-64a8c6fbbca8 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 404 len: 111 microversion: 2.1 time: 0.036928 Jun 14 19:48:22.119594 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 409/839] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:22 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:48:22.126725 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e365c88e-b289-4d2b-95bc-92a8c1197230 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '.version_select at 0x7f144ad30af0>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:22.151404 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e365c88e-b289-4d2b-95bc-92a8c1197230 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-246172722" status: 202 len: 0 microversion: 2.1 time: 0.028774 Jun 14 19:48:22.152291 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 431/840] 10.222.0.44 () {58 vars in 1217 bytes} [Tue Jun 14 19:48:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-246172722 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:48:25.064747 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d0d5d0a7-09ec-4441-9847-3c7b35f3eeed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:25.065277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d0d5d0a7-09ec-4441-9847-3c7b35f3eeed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:25.073282 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d0d5d0a7-09ec-4441-9847-3c7b35f3eeed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:25.073826 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d0d5d0a7-09ec-4441-9847-3c7b35f3eeed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:25.074599 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d0d5d0a7-09ec-4441-9847-3c7b35f3eeed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:25.075033 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d0d5d0a7-09ec-4441-9847-3c7b35f3eeed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:25.088531 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-d0d5d0a7-09ec-4441-9847-3c7b35f3eeed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] HTTP exception thrown: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d0d5d0a7-09ec-4441-9847-3c7b35f3eeed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Request method failure captured: Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: DELETE /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 HTTP/1.1 Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSU6jdf10-DjmYngwGNTGvxjJRWPyC6wno2zEwQBLtN3rsIaP6a83KjWJ2eEIEENFajV9OR0kxR8PY7ebZx2v8ZG5Gr_0T-BD99J6FCbhRE3UFARQrnTpmRPHub0_6quHGwF_vPrL5Q91pvvvRBb_-WMhzCg_dG8m52-AbYYa2CXEM Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: f4aa8aab8447434b8619c3b7bb0b585a Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:48:25.090098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:48:25.091604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4aa8aab8447434b8619c3b7bb0b585a"}]}] Jun 14 19:48:25.091604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:48:25.091604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: f4aa8aab8447434b8619c3b7bb0b585a Jun 14 19:48:25.091604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:48:25.091604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeTestJSON-60739376-project Jun 14 19:48:25.091604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:48:25.091604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:48:25.091604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 18261f10678a4ce99626794c39bb5d7f Jun 14 19:48:25.091604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeTestJSON-60739376-project Jun 14 19:48:25.091604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:48:25.091604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. Jun 14 19:48:25.091604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '55328760-5eb8-4c2b-bed1-b75b972100a7'} Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:48:25.092498 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. Jun 14 19:48:25.093783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:25.095077 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d0d5d0a7-09ec-4441-9847-3c7b35f3eeed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Returning 404 to user: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:48:25.095077 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d0d5d0a7-09ec-4441-9847-3c7b35f3eeed tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 404 len: 111 microversion: 2.1 time: 0.030547 Jun 14 19:48:25.095077 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 410/841] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:48:25 2022] DELETE /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:48:25.100425 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-487e3e48-2f88-4a70-bdd1-b214579a0086 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:25.101411 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-487e3e48-2f88-4a70-bdd1-b214579a0086 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 55328760-5eb8-4c2b-bed1-b75b972100a7] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:25.108201 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-487e3e48-2f88-4a70-bdd1-b214579a0086 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:25.108720 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-487e3e48-2f88-4a70-bdd1-b214579a0086 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:25.109688 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-487e3e48-2f88-4a70-bdd1-b214579a0086 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:25.110131 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-487e3e48-2f88-4a70-bdd1-b214579a0086 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:25.125527 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-487e3e48-2f88-4a70-bdd1-b214579a0086 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] HTTP exception thrown: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-487e3e48-2f88-4a70-bdd1-b214579a0086 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Request method failure captured: Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 HTTP/1.1 Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOSU6jdf10-DjmYngwGNTGvxjJRWPyC6wno2zEwQBLtN3rsIaP6a83KjWJ2eEIEENFajV9OR0kxR8PY7ebZx2v8ZG5Gr_0T-BD99J6FCbhRE3UFARQrnTpmRPHub0_6quHGwF_vPrL5Q91pvvvRBb_-WMhzCg_dG8m52-AbYYa2CXEM Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: f4aa8aab8447434b8619c3b7bb0b585a Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:48:25.127259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:48:25.128915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4aa8aab8447434b8619c3b7bb0b585a"}]}] Jun 14 19:48:25.128915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:48:25.128915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: f4aa8aab8447434b8619c3b7bb0b585a Jun 14 19:48:25.128915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:48:25.128915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-AttachVolumeTestJSON-60739376-project Jun 14 19:48:25.128915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:48:25.128915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:48:25.128915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 18261f10678a4ce99626794c39bb5d7f Jun 14 19:48:25.128915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-AttachVolumeTestJSON-60739376-project Jun 14 19:48:25.128915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:48:25.128915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. Jun 14 19:48:25.128915 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': '55328760-5eb8-4c2b-bed1-b75b972100a7'} Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:48:25.129831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. Jun 14 19:48:25.131295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:25.133819 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-487e3e48-2f88-4a70-bdd1-b214579a0086 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Returning 404 to user: Instance 55328760-5eb8-4c2b-bed1-b75b972100a7 could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:48:25.133819 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-487e3e48-2f88-4a70-bdd1-b214579a0086 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7" status: 404 len: 111 microversion: 2.1 time: 0.032977 Jun 14 19:48:25.133819 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 432/842] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:25 2022] GET /compute/v2.1/servers/55328760-5eb8-4c2b-bed1-b75b972100a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:48:26.262583 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c1fa9454-ab06-49e8-957b-c25def2c39c0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:26.263095 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c1fa9454-ab06-49e8-957b-c25def2c39c0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:26.269747 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c1fa9454-ab06-49e8-957b-c25def2c39c0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:26.270197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c1fa9454-ab06-49e8-957b-c25def2c39c0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:26.270956 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c1fa9454-ab06-49e8-957b-c25def2c39c0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:26.271389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c1fa9454-ab06-49e8-957b-c25def2c39c0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:26.285688 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-c1fa9454-ab06-49e8-957b-c25def2c39c0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] HTTP exception thrown: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c1fa9454-ab06-49e8-957b-c25def2c39c0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Request method failure captured: Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: DELETE /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 HTTP/1.1 Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSU6jdf10-DjmYngwGNTGvxjJRWPyC6wno2zEwQBLtN3rsIaP6a83KjWJ2eEIEENFajV9OR0kxR8PY7ebZx2v8ZG5Gr_0T-BD99J6FCbhRE3UFARQrnTpmRPHub0_6quHGwF_vPrL5Q91pvvvRBb_-WMhzCg_dG8m52-AbYYa2CXEM Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: f4aa8aab8447434b8619c3b7bb0b585a Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:48:26.287217 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:48:26.289159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4aa8aab8447434b8619c3b7bb0b585a"}]}] Jun 14 19:48:26.289159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:48:26.289159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: f4aa8aab8447434b8619c3b7bb0b585a Jun 14 19:48:26.289159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:48:26.289159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeTestJSON-60739376-project Jun 14 19:48:26.289159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:48:26.289159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:48:26.289159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 18261f10678a4ce99626794c39bb5d7f Jun 14 19:48:26.289159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeTestJSON-60739376-project Jun 14 19:48:26.289159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:48:26.289159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. Jun 14 19:48:26.289159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '519d4f97-34a0-4df8-85fe-98149ad589a8'} Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:48:26.290013 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. Jun 14 19:48:26.291411 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:26.292803 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c1fa9454-ab06-49e8-957b-c25def2c39c0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Returning 404 to user: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:48:26.292803 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c1fa9454-ab06-49e8-957b-c25def2c39c0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 404 len: 111 microversion: 2.1 time: 0.030260 Jun 14 19:48:26.292803 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 411/843] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:48:26 2022] DELETE /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:48:26.297343 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-67c59f5c-f616-47c9-a6b1-8677e92e4ff0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:26.298106 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-67c59f5c-f616-47c9-a6b1-8677e92e4ff0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] [instance: 519d4f97-34a0-4df8-85fe-98149ad589a8] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:26.304590 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-67c59f5c-f616-47c9-a6b1-8677e92e4ff0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:26.305043 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-67c59f5c-f616-47c9-a6b1-8677e92e4ff0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:26.305844 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-67c59f5c-f616-47c9-a6b1-8677e92e4ff0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:26.306572 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-67c59f5c-f616-47c9-a6b1-8677e92e4ff0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:26.321497 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-67c59f5c-f616-47c9-a6b1-8677e92e4ff0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] HTTP exception thrown: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-67c59f5c-f616-47c9-a6b1-8677e92e4ff0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Request method failure captured: Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 HTTP/1.1 Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOSU6jdf10-DjmYngwGNTGvxjJRWPyC6wno2zEwQBLtN3rsIaP6a83KjWJ2eEIEENFajV9OR0kxR8PY7ebZx2v8ZG5Gr_0T-BD99J6FCbhRE3UFARQrnTpmRPHub0_6quHGwF_vPrL5Q91pvvvRBb_-WMhzCg_dG8m52-AbYYa2CXEM Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: f4aa8aab8447434b8619c3b7bb0b585a Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:48:26.323014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:48:26.324584 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4aa8aab8447434b8619c3b7bb0b585a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4aa8aab8447434b8619c3b7bb0b585a"}]}] Jun 14 19:48:26.324584 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:48:26.324584 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: f4aa8aab8447434b8619c3b7bb0b585a Jun 14 19:48:26.324584 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-AttachVolumeTestJSON-60739376 Jun 14 19:48:26.324584 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-AttachVolumeTestJSON-60739376-project Jun 14 19:48:26.324584 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:48:26.324584 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:48:26.324584 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 18261f10678a4ce99626794c39bb5d7f Jun 14 19:48:26.324584 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-AttachVolumeTestJSON-60739376-project Jun 14 19:48:26.324584 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:48:26.324584 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. Jun 14 19:48:26.324584 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': '519d4f97-34a0-4df8-85fe-98149ad589a8'} Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:48:26.325601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. Jun 14 19:48:26.327035 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:48:26.328335 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-67c59f5c-f616-47c9-a6b1-8677e92e4ff0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] Returning 404 to user: Instance 519d4f97-34a0-4df8-85fe-98149ad589a8 could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:48:26.328335 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-67c59f5c-f616-47c9-a6b1-8677e92e4ff0 tempest-AttachVolumeTestJSON-60739376 tempest-AttachVolumeTestJSON-60739376-project] 10.222.0.44 "GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8" status: 404 len: 111 microversion: 2.1 time: 0.030924 Jun 14 19:48:26.328335 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 433/844] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:26 2022] GET /compute/v2.1/servers/519d4f97-34a0-4df8-85fe-98149ad589a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:48:41.627216 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a2803e62-f4b9-4bbe-b59c-2738ebfd20c3 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:41.627732 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a2803e62-f4b9-4bbe-b59c-2738ebfd20c3 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:41.630290 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:41.631548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:41.637950 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a2803e62-f4b9-4bbe-b59c-2738ebfd20c3 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:41.638399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a2803e62-f4b9-4bbe-b59c-2738ebfd20c3 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:41.639160 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a2803e62-f4b9-4bbe-b59c-2738ebfd20c3 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:41.639591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a2803e62-f4b9-4bbe-b59c-2738ebfd20c3 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:41.723756 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.objects.instance [None req-a2803e62-f4b9-4bbe-b59c-2738ebfd20c3 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lazy-loading 'services' on Instance uuid 5d5b449e-0612-4e56-963b-5841afefea1c {{(pid=124069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:48:41.799471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a2803e62-f4b9-4bbe-b59c-2738ebfd20c3 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c/os-volume_attachments/189bb7d2-d059-4d8a-917d-b5ef3c8b2e4c" status: 202 len: 0 microversion: 2.1 time: 0.175827 Jun 14 19:48:41.800155 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 412/845] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 14 19:48:41 2022] DELETE /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c/os-volume_attachments/189bb7d2-d059-4d8a-917d-b5ef3c8b2e4c => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:48:42.944598 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-dc4d4b31-dbf8-4bad-8296-899d21a645b5 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:42.945099 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-dc4d4b31-dbf8-4bad-8296-899d21a645b5 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:42.948617 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:42.949772 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:42.962384 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dc4d4b31-dbf8-4bad-8296-899d21a645b5 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:42.962384 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dc4d4b31-dbf8-4bad-8296-899d21a645b5 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:42.962384 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dc4d4b31-dbf8-4bad-8296-899d21a645b5 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:42.962384 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dc4d4b31-dbf8-4bad-8296-899d21a645b5 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:42.987705 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-dc4d4b31-dbf8-4bad-8296-899d21a645b5 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Going to try to terminate instance {{(pid=124068) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:48:43.070076 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-dc4d4b31-dbf8-4bad-8296-899d21a645b5 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 204 len: 0 microversion: 2.1 time: 0.129742 Jun 14 19:48:43.070744 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 434/846] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:48:42 2022] DELETE /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:48:43.081877 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c37a0a60-3a44-4353-8c39-eb6842910e7f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:43.082763 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c37a0a60-3a44-4353-8c39-eb6842910e7f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:43.089680 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c37a0a60-3a44-4353-8c39-eb6842910e7f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:43.090129 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c37a0a60-3a44-4353-8c39-eb6842910e7f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:43.090902 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c37a0a60-3a44-4353-8c39-eb6842910e7f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:43.091334 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c37a0a60-3a44-4353-8c39-eb6842910e7f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:43.253826 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c37a0a60-3a44-4353-8c39-eb6842910e7f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:43.263314 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c37a0a60-3a44-4353-8c39-eb6842910e7f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1513 microversion: 2.1 time: 0.187099 Jun 14 19:48:43.263967 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 413/847] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:43 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:48:44.282524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1412f838-f3c7-48ed-bff6-a27228c1787d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:44.283230 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1412f838-f3c7-48ed-bff6-a27228c1787d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:44.290425 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1412f838-f3c7-48ed-bff6-a27228c1787d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:44.290879 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1412f838-f3c7-48ed-bff6-a27228c1787d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:44.291654 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1412f838-f3c7-48ed-bff6-a27228c1787d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:44.292089 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1412f838-f3c7-48ed-bff6-a27228c1787d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:44.431082 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1412f838-f3c7-48ed-bff6-a27228c1787d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:44.439245 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1412f838-f3c7-48ed-bff6-a27228c1787d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1513 microversion: 2.1 time: 0.161075 Jun 14 19:48:44.439792 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 435/848] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:44 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:48:45.456149 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9a54ffd2-21da-4753-9b26-250d65eb75c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:45.456725 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9a54ffd2-21da-4753-9b26-250d65eb75c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:45.463823 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a54ffd2-21da-4753-9b26-250d65eb75c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:45.464268 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a54ffd2-21da-4753-9b26-250d65eb75c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:45.465065 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a54ffd2-21da-4753-9b26-250d65eb75c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:45.466354 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9a54ffd2-21da-4753-9b26-250d65eb75c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:45.628401 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9a54ffd2-21da-4753-9b26-250d65eb75c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:45.638936 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9a54ffd2-21da-4753-9b26-250d65eb75c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 200 len: 1513 microversion: 2.1 time: 0.186324 Jun 14 19:48:45.648878 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 414/849] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:45 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:45.725646 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-6f9b540f-a7e5-4b56-8ee5-8cbc64f83aff req-9fb2b924-f0d3-464d-aca1-03c364be9467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5b449e-0612-4e56-963b-5841afefea1c", "name": "network-vif-deleted", "tag": "94c03a74-6929-4077-a3f8-7be44d15be23"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:48:45.739591 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-6f9b540f-a7e5-4b56-8ee5-8cbc64f83aff req-9fb2b924-f0d3-464d-aca1-03c364be9467 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:45.740074 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-6f9b540f-a7e5-4b56-8ee5-8cbc64f83aff req-9fb2b924-f0d3-464d-aca1-03c364be9467 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:45.754053 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-6f9b540f-a7e5-4b56-8ee5-8cbc64f83aff req-9fb2b924-f0d3-464d-aca1-03c364be9467 service nova] Creating event network-vif-deleted:94c03a74-6929-4077-a3f8-7be44d15be23 for instance 5d5b449e-0612-4e56-963b-5841afefea1c on hv-cinder-84580 Jun 14 19:48:45.759609 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-6f9b540f-a7e5-4b56-8ee5-8cbc64f83aff req-9fb2b924-f0d3-464d-aca1-03c364be9467 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038039 Jun 14 19:48:45.760433 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 436/850] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:48:46.656087 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a6e13c73-b885-49de-b7a8-1e7460d4ab7d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:46.656767 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a6e13c73-b885-49de-b7a8-1e7460d4ab7d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: 5d5b449e-0612-4e56-963b-5841afefea1c] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:46.664819 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a6e13c73-b885-49de-b7a8-1e7460d4ab7d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:46.665283 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a6e13c73-b885-49de-b7a8-1e7460d4ab7d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:46.666075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a6e13c73-b885-49de-b7a8-1e7460d4ab7d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:46.666502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a6e13c73-b885-49de-b7a8-1e7460d4ab7d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:46.681140 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-a6e13c73-b885-49de-b7a8-1e7460d4ab7d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] HTTP exception thrown: Instance 5d5b449e-0612-4e56-963b-5841afefea1c could not be found. Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a6e13c73-b885-49de-b7a8-1e7460d4ab7d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Request method failure captured: Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c HTTP/1.1 Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOXZs_MnG8DnNphfd4QssxcjWn22NShUEYTrhJBUebm55LU8pgrponTh-3y2g8XypHs2shqC5Jh-wfe70FR2SaPo03uirWY-hzP4N73Z_SMJSth0iYJrgLtVTexMAMC7cRSF_6MaEilW2t3-V2XI1EQaUPT8I4vOc5w-CaCa7FLtUgs Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: 35a27fefe9ec41c09c01d67ec3d75683 Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-VolumesSnapshotTestJSON-606613241 Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:48:46.683136 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:48:46.684849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/35a27fefe9ec41c09c01d67ec3d75683"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_35a27fefe9ec41c09c01d67ec3d75683"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/35a27fefe9ec41c09c01d67ec3d75683"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/35a27fefe9ec41c09c01d67ec3d75683"}]}] Jun 14 19:48:46.684849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-VolumesSnapshotTestJSON-606613241 Jun 14 19:48:46.684849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: 35a27fefe9ec41c09c01d67ec3d75683 Jun 14 19:48:46.684849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-606613241 Jun 14 19:48:46.684849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-VolumesSnapshotTestJSON-606613241-project Jun 14 19:48:46.684849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:48:46.684849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:48:46.684849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 2900dfb691734898a5fd1ac12207cebf Jun 14 19:48:46.684849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-VolumesSnapshotTestJSON-606613241-project Jun 14 19:48:46.684849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:48:46.684849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance 5d5b449e-0612-4e56-963b-5841afefea1c could not be found. Jun 14 19:48:46.684849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '5d5b449e-0612-4e56-963b-5841afefea1c'} Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d5b449e-0612-4e56-963b-5841afefea1c could not be found. Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:48:46.685614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d5b449e-0612-4e56-963b-5841afefea1c could not be found. Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d5b449e-0612-4e56-963b-5841afefea1c could not be found. Jun 14 19:48:46.686807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:48:46.687853 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a6e13c73-b885-49de-b7a8-1e7460d4ab7d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Returning 404 to user: Instance 5d5b449e-0612-4e56-963b-5841afefea1c could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:48:46.687853 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a6e13c73-b885-49de-b7a8-1e7460d4ab7d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c" status: 404 len: 111 microversion: 2.1 time: 0.032599 Jun 14 19:48:46.687853 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 415/851] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:48:46 2022] GET /compute/v2.1/servers/5d5b449e-0612-4e56-963b-5841afefea1c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:48:55.672284 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-72c61515-c1d1-4f19-a0de-33b978389d9f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:55.673272 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-72c61515-c1d1-4f19-a0de-33b978389d9f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:55.680173 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72c61515-c1d1-4f19-a0de-33b978389d9f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:55.680616 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72c61515-c1d1-4f19-a0de-33b978389d9f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:55.681523 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72c61515-c1d1-4f19-a0de-33b978389d9f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:55.681956 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-72c61515-c1d1-4f19-a0de-33b978389d9f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:55.709132 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-72c61515-c1d1-4f19-a0de-33b978389d9f tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041870 Jun 14 19:48:55.709710 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 437/852] 10.222.0.44 () {60 vars in 1342 bytes} [Tue Jun 14 19:48:55 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:48:55.766338 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c0c4b386-5d6f-4bf8-932d-0a69edef705c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:55.766859 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c0c4b386-5d6f-4bf8-932d-0a69edef705c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:55.774297 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0c4b386-5d6f-4bf8-932d-0a69edef705c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:55.774744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0c4b386-5d6f-4bf8-932d-0a69edef705c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:55.775506 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0c4b386-5d6f-4bf8-932d-0a69edef705c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:55.775939 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c0c4b386-5d6f-4bf8-932d-0a69edef705c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:55.800940 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c0c4b386-5d6f-4bf8-932d-0a69edef705c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Going to try to terminate instance {{(pid=124069) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:48:55.876671 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c0c4b386-5d6f-4bf8-932d-0a69edef705c tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "DELETE /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 204 len: 0 microversion: 2.20 time: 0.113905 Jun 14 19:48:55.880574 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 416/853] 10.222.0.44 () {60 vars in 1279 bytes} [Tue Jun 14 19:48:55 2022] DELETE /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 14 19:48:55.886594 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-32cd081f-4683-4ddf-95ca-f99686731071 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:55.887205 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-32cd081f-4683-4ddf-95ca-f99686731071 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:55.893818 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-32cd081f-4683-4ddf-95ca-f99686731071 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:55.894264 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-32cd081f-4683-4ddf-95ca-f99686731071 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:55.895020 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-32cd081f-4683-4ddf-95ca-f99686731071 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:55.895450 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-32cd081f-4683-4ddf-95ca-f99686731071 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:56.026443 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-32cd081f-4683-4ddf-95ca-f99686731071 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:56.034288 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-32cd081f-4683-4ddf-95ca-f99686731071 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:56.035789 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-32cd081f-4683-4ddf-95ca-f99686731071 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:56.036926 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-32cd081f-4683-4ddf-95ca-f99686731071 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.155048 Jun 14 19:48:56.037500 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 438/854] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:48:55 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:48:57.056484 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-26910b2e-a318-46e0-ab0a-7cca2f1e2c98 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:57.057099 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-26910b2e-a318-46e0-ab0a-7cca2f1e2c98 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:57.063563 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-26910b2e-a318-46e0-ab0a-7cca2f1e2c98 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:57.064018 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-26910b2e-a318-46e0-ab0a-7cca2f1e2c98 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:57.064778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-26910b2e-a318-46e0-ab0a-7cca2f1e2c98 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:57.065213 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-26910b2e-a318-46e0-ab0a-7cca2f1e2c98 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:57.193717 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-26910b2e-a318-46e0-ab0a-7cca2f1e2c98 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:57.201724 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-26910b2e-a318-46e0-ab0a-7cca2f1e2c98 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:57.203268 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-26910b2e-a318-46e0-ab0a-7cca2f1e2c98 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:57.204449 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-26910b2e-a318-46e0-ab0a-7cca2f1e2c98 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.152826 Jun 14 19:48:57.205036 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 417/855] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:48:57 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:48:58.222930 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b5ab1053-9f9d-42b3-8f61-19fc54b90243 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:58.223543 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b5ab1053-9f9d-42b3-8f61-19fc54b90243 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:58.230161 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b5ab1053-9f9d-42b3-8f61-19fc54b90243 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:58.230611 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b5ab1053-9f9d-42b3-8f61-19fc54b90243 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:58.231372 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b5ab1053-9f9d-42b3-8f61-19fc54b90243 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:58.231809 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b5ab1053-9f9d-42b3-8f61-19fc54b90243 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:58.358122 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b5ab1053-9f9d-42b3-8f61-19fc54b90243 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:58.366551 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b5ab1053-9f9d-42b3-8f61-19fc54b90243 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:58.368237 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b5ab1053-9f9d-42b3-8f61-19fc54b90243 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:58.369396 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b5ab1053-9f9d-42b3-8f61-19fc54b90243 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.150317 Jun 14 19:48:58.369973 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 439/856] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:48:58 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:48:59.388247 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9692a9e9-1034-4ae2-a879-d6b89342b477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:48:59.389584 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9692a9e9-1034-4ae2-a879-d6b89342b477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:48:59.396441 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9692a9e9-1034-4ae2-a879-d6b89342b477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:59.396881 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9692a9e9-1034-4ae2-a879-d6b89342b477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:59.398832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9692a9e9-1034-4ae2-a879-d6b89342b477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:48:59.399261 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9692a9e9-1034-4ae2-a879-d6b89342b477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:48:59.530061 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9692a9e9-1034-4ae2-a879-d6b89342b477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:59.538012 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9692a9e9-1034-4ae2-a879-d6b89342b477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:59.539515 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9692a9e9-1034-4ae2-a879-d6b89342b477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:48:59.540658 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9692a9e9-1034-4ae2-a879-d6b89342b477 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.156287 Jun 14 19:48:59.541213 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 418/857] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:48:59 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:48:59.763535 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1685290523", "imageRef": "05b8cbeb-f66c-4f66-8c42-87da80edad6d", "flavorRef": "452", "networks": [{"uuid": "e6d03972-7a1d-4299-9c92-43b099faaa8b"}]}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:48:59.813585 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.network.neutron [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] validate_networks() for [('e6d03972-7a1d-4299-9c92-43b099faaa8b', None, None, None, None, None)] {{(pid=124068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:49:00.251580 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Flavor limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:49:00.252007 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Image limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:49:00.252481 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Flavor pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:49:00.252892 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Image pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:49:00.253305 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:49:00.263091 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:00.263535 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:00.264333 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:00.264770 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:00.281461 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Getting quotas for project 35a27fefe9ec41c09c01d67ec3d75683. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:49:00.285316 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Getting quotas for user 2900dfb691734898a5fd1ac12207cebf and project 35a27fefe9ec41c09c01d67ec3d75683. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:49:00.296066 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Going to run 1 instances... {{(pid=124068) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:49:00.298318 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05b8cbeb-f66c-4f66-8c42-87da80edad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:49:00.342880 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a34a2872-e5e5-43c1-9392-aa71551b0146 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583069 Jun 14 19:49:00.343515 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 440/858] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:48:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:49:00.353554 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b199e0d3-f6cc-4d49-9e32-cd6168103121 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:00.354175 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b199e0d3-f6cc-4d49-9e32-cd6168103121 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:00.409510 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-b199e0d3-f6cc-4d49-9e32-cd6168103121 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:00.416652 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b199e0d3-f6cc-4d49-9e32-cd6168103121 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1219 microversion: 2.1 time: 0.067004 Jun 14 19:49:00.417216 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 419/859] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:00 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:00.560294 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d495ac49-097b-4b6f-94c0-f2cd9fd51962 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:00.560960 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d495ac49-097b-4b6f-94c0-f2cd9fd51962 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:00.567488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d495ac49-097b-4b6f-94c0-f2cd9fd51962 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:00.567972 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d495ac49-097b-4b6f-94c0-f2cd9fd51962 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:00.568741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d495ac49-097b-4b6f-94c0-f2cd9fd51962 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:00.569859 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d495ac49-097b-4b6f-94c0-f2cd9fd51962 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:00.708459 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d495ac49-097b-4b6f-94c0-f2cd9fd51962 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:00.716914 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d495ac49-097b-4b6f-94c0-f2cd9fd51962 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:00.718457 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d495ac49-097b-4b6f-94c0-f2cd9fd51962 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:00.719638 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d495ac49-097b-4b6f-94c0-f2cd9fd51962 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.164152 Jun 14 19:49:00.720189 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 441/860] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:49:00 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:49:01.433712 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-5642fd7b-8f7f-4284-aa1f-7dea6df7bf81 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:01.434731 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-5642fd7b-8f7f-4284-aa1f-7dea6df7bf81 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:01.442014 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5642fd7b-8f7f-4284-aa1f-7dea6df7bf81 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:01.442458 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5642fd7b-8f7f-4284-aa1f-7dea6df7bf81 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:01.443214 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5642fd7b-8f7f-4284-aa1f-7dea6df7bf81 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:01.443644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5642fd7b-8f7f-4284-aa1f-7dea6df7bf81 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:01.502361 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-5642fd7b-8f7f-4284-aa1f-7dea6df7bf81 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:01.510712 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-5642fd7b-8f7f-4284-aa1f-7dea6df7bf81 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1223 microversion: 2.1 time: 0.080990 Jun 14 19:49:01.511297 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 420/861] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:01 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:01.737823 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-01e15ba2-0ca0-4406-962e-105efcd9a848 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:01.738411 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-01e15ba2-0ca0-4406-962e-105efcd9a848 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:01.745600 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-01e15ba2-0ca0-4406-962e-105efcd9a848 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:01.746046 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-01e15ba2-0ca0-4406-962e-105efcd9a848 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:01.746797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-01e15ba2-0ca0-4406-962e-105efcd9a848 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:01.747225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-01e15ba2-0ca0-4406-962e-105efcd9a848 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:01.885017 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-01e15ba2-0ca0-4406-962e-105efcd9a848 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:01.893166 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-01e15ba2-0ca0-4406-962e-105efcd9a848 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:01.894807 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-01e15ba2-0ca0-4406-962e-105efcd9a848 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:01.896236 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-01e15ba2-0ca0-4406-962e-105efcd9a848 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1725 microversion: 2.20 time: 0.162029 Jun 14 19:49:01.896788 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 442/862] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:49:01 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:49:02.528655 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-86106161-59ea-4f82-a6c2-e9f2fc942cac tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:02.529894 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-86106161-59ea-4f82-a6c2-e9f2fc942cac tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:02.536665 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-86106161-59ea-4f82-a6c2-e9f2fc942cac tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:02.537362 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-86106161-59ea-4f82-a6c2-e9f2fc942cac tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:02.538836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-86106161-59ea-4f82-a6c2-e9f2fc942cac tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:02.539384 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-86106161-59ea-4f82-a6c2-e9f2fc942cac tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:02.603384 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-86106161-59ea-4f82-a6c2-e9f2fc942cac tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:02.611380 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-86106161-59ea-4f82-a6c2-e9f2fc942cac tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1277 microversion: 2.1 time: 0.086702 Jun 14 19:49:02.617425 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 421/863] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:02 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:02.915048 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-be6d2c1d-2485-4507-b64a-5319f9fc477e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:02.915963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-be6d2c1d-2485-4507-b64a-5319f9fc477e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:02.932450 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-be6d2c1d-2485-4507-b64a-5319f9fc477e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:02.933281 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-be6d2c1d-2485-4507-b64a-5319f9fc477e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:02.934247 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-be6d2c1d-2485-4507-b64a-5319f9fc477e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:02.934850 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-be6d2c1d-2485-4507-b64a-5319f9fc477e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:03.025983 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-be6d2c1d-2485-4507-b64a-5319f9fc477e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:03.034201 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-be6d2c1d-2485-4507-b64a-5319f9fc477e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:03.035947 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-be6d2c1d-2485-4507-b64a-5319f9fc477e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60ed90fb1a54339ac563bc649e98989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070bbe844e8945eca60ecc95244acd53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:03.037291 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-be6d2c1d-2485-4507-b64a-5319f9fc477e tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 200 len: 1657 microversion: 2.20 time: 0.127670 Jun 14 19:49:03.038521 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 443/864] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:49:02 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 1657 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 19:49:03.223022 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-4addb06f-affe-491a-afe6-b9cfe69bda51 req-9d2051b6-963b-447b-a49f-55b3a25f2127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574d3163-12b7-4f68-9f90-445a0d1b0b8e", "name": "network-vif-deleted", "tag": "367ce7c0-470d-4698-8a1e-52c8e78f7f64"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:49:03.233535 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-4addb06f-affe-491a-afe6-b9cfe69bda51 req-9d2051b6-963b-447b-a49f-55b3a25f2127 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:03.234076 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-4addb06f-affe-491a-afe6-b9cfe69bda51 req-9d2051b6-963b-447b-a49f-55b3a25f2127 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:03.263344 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-4addb06f-affe-491a-afe6-b9cfe69bda51 req-9d2051b6-963b-447b-a49f-55b3a25f2127 service nova] Creating event network-vif-deleted:367ce7c0-470d-4698-8a1e-52c8e78f7f64 for instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e on hv-cinder-84580 Jun 14 19:49:03.272577 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-4addb06f-affe-491a-afe6-b9cfe69bda51 req-9d2051b6-963b-447b-a49f-55b3a25f2127 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052836 Jun 14 19:49:03.277809 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 422/865] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:49:03.628550 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-93f58626-3a68-4287-b3d1-bcac4e043685 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:03.629693 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-93f58626-3a68-4287-b3d1-bcac4e043685 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:03.636775 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-93f58626-3a68-4287-b3d1-bcac4e043685 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:03.637297 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-93f58626-3a68-4287-b3d1-bcac4e043685 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:03.638185 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-93f58626-3a68-4287-b3d1-bcac4e043685 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:03.638699 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-93f58626-3a68-4287-b3d1-bcac4e043685 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:03.783231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-93f58626-3a68-4287-b3d1-bcac4e043685 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:03.792215 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-93f58626-3a68-4287-b3d1-bcac4e043685 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1319 microversion: 2.1 time: 0.167855 Jun 14 19:49:03.793486 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 444/866] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:03 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:04.059317 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9b3e826e-20f8-4142-aa8a-0292d2779db2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:04.060124 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9b3e826e-20f8-4142-aa8a-0292d2779db2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:04.067570 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9b3e826e-20f8-4142-aa8a-0292d2779db2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:04.068221 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9b3e826e-20f8-4142-aa8a-0292d2779db2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:04.069052 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9b3e826e-20f8-4142-aa8a-0292d2779db2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:04.069678 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9b3e826e-20f8-4142-aa8a-0292d2779db2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:04.083975 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-9b3e826e-20f8-4142-aa8a-0292d2779db2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] HTTP exception thrown: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9b3e826e-20f8-4142-aa8a-0292d2779db2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Request method failure captured: Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e HTTP/1.1 Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSGSyi__YACn28acM6Q8Pka71yXqU1v4hFXT4AS5dvj4sf2iufYAfzc3rSHEa6Ow771gvgY3ceCNxgLbE9eIdBJWdECrPGV2nniAl-4WAsQqmmGCSx45YB-EN0lKvl-wZ6GoCJfWU4iA5jvlxuapGSCrtzh7F1ghRL35mYwWCG-nXE Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: 070bbe844e8945eca60ecc95244acd53 Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:49:04.086303 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:49:04.087832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/070bbe844e8945eca60ecc95244acd53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_070bbe844e8945eca60ecc95244acd53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/070bbe844e8945eca60ecc95244acd53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/070bbe844e8945eca60ecc95244acd53"}]}] Jun 14 19:49:04.087832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:49:04.087832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: 070bbe844e8945eca60ecc95244acd53 Jun 14 19:49:04.087832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:49:04.087832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeShelveTestJSON-1507149085-project Jun 14 19:49:04.087832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:49:04.087832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:49:04.087832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: f60ed90fb1a54339ac563bc649e98989 Jun 14 19:49:04.087832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1507149085-project Jun 14 19:49:04.087832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:49:04.087832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. Jun 14 19:49:04.087832 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '574d3163-12b7-4f68-9f90-445a0d1b0b8e'} Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:49:04.088668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. Jun 14 19:49:04.089973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:04.091134 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9b3e826e-20f8-4142-aa8a-0292d2779db2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Returning 404 to user: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:49:04.091134 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9b3e826e-20f8-4142-aa8a-0292d2779db2 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 404 len: 111 microversion: 2.20 time: 0.035499 Jun 14 19:49:04.091134 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 423/867] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:49:04 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 14 19:49:04.097164 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-92746547-93e2-4f2b-bc4f-60863395fdf6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '.version_select at 0x7f144acc8af0>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:04.119090 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-92746547-93e2-4f2b-bc4f-60863395fdf6 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080798083" status: 204 len: 0 microversion: 2.20 time: 0.025882 Jun 14 19:49:04.123158 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 445/868] 10.222.0.44 () {60 vars in 1261 bytes} [Tue Jun 14 19:49:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080798083 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 14 19:49:04.126664 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-4bd7010c-49a6-40de-8236-f2c33f6bf834 req-4673705f-091b-4f92-8f25-1674233c619c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7493ef4-9e6b-4a6f-ac7e-885666b16626", "tag": "3e0dd0c0-1990-40e6-bc79-3c7f42bfca6a"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:49:04.135892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-4bd7010c-49a6-40de-8236-f2c33f6bf834 req-4673705f-091b-4f92-8f25-1674233c619c service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:04.136332 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-4bd7010c-49a6-40de-8236-f2c33f6bf834 req-4673705f-091b-4f92-8f25-1674233c619c service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:04.154203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-4bd7010c-49a6-40de-8236-f2c33f6bf834 req-4673705f-091b-4f92-8f25-1674233c619c service nova] Creating event network-changed:3e0dd0c0-1990-40e6-bc79-3c7f42bfca6a for instance a7493ef4-9e6b-4a6f-ac7e-885666b16626 on hv-cinder-84580 Jun 14 19:49:04.160228 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-4bd7010c-49a6-40de-8236-f2c33f6bf834 req-4673705f-091b-4f92-8f25-1674233c619c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037655 Jun 14 19:49:04.160869 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 424/869] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:49:04.809829 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f5ea007a-02ce-4bb9-821a-5eb433d27567 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:04.811086 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f5ea007a-02ce-4bb9-821a-5eb433d27567 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:04.821315 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f5ea007a-02ce-4bb9-821a-5eb433d27567 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:04.821804 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f5ea007a-02ce-4bb9-821a-5eb433d27567 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:04.822591 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f5ea007a-02ce-4bb9-821a-5eb433d27567 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:04.823030 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f5ea007a-02ce-4bb9-821a-5eb433d27567 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:04.954010 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-f5ea007a-02ce-4bb9-821a-5eb433d27567 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:04.961758 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f5ea007a-02ce-4bb9-821a-5eb433d27567 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1319 microversion: 2.1 time: 0.156027 Jun 14 19:49:04.962309 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 446/870] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:04 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:05.979669 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2ad54111-3cae-4a0b-b397-bd494167b071 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:05.980365 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-2ad54111-3cae-4a0b-b397-bd494167b071 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:05.986604 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2ad54111-3cae-4a0b-b397-bd494167b071 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:05.987044 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2ad54111-3cae-4a0b-b397-bd494167b071 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:05.987787 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2ad54111-3cae-4a0b-b397-bd494167b071 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:05.988216 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-2ad54111-3cae-4a0b-b397-bd494167b071 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:06.117108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-2ad54111-3cae-4a0b-b397-bd494167b071 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:06.124590 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2ad54111-3cae-4a0b-b397-bd494167b071 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1319 microversion: 2.1 time: 0.150038 Jun 14 19:49:06.125140 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 425/871] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:05 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:07.141173 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a6c4090b-d07c-4520-ae3c-587cf5359b7c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:07.141923 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a6c4090b-d07c-4520-ae3c-587cf5359b7c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:07.149365 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a6c4090b-d07c-4520-ae3c-587cf5359b7c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:07.149849 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a6c4090b-d07c-4520-ae3c-587cf5359b7c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:07.150642 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a6c4090b-d07c-4520-ae3c-587cf5359b7c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:07.151079 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a6c4090b-d07c-4520-ae3c-587cf5359b7c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:07.289533 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a6c4090b-d07c-4520-ae3c-587cf5359b7c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:07.296759 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a6c4090b-d07c-4520-ae3c-587cf5359b7c tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1319 microversion: 2.1 time: 0.159433 Jun 14 19:49:07.297347 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 447/872] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:07 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:08.016078 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a23e1c6a-a928-4bbc-b906-471e3e2767d3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:08.016563 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a23e1c6a-a928-4bbc-b906-471e3e2767d3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:08.023469 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a23e1c6a-a928-4bbc-b906-471e3e2767d3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:08.023914 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a23e1c6a-a928-4bbc-b906-471e3e2767d3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:08.024681 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a23e1c6a-a928-4bbc-b906-471e3e2767d3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:08.025108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a23e1c6a-a928-4bbc-b906-471e3e2767d3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:08.038432 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-a23e1c6a-a928-4bbc-b906-471e3e2767d3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] HTTP exception thrown: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a23e1c6a-a928-4bbc-b906-471e3e2767d3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Request method failure captured: Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: DELETE /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e HTTP/1.1 Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSGSyi__YACn28acM6Q8Pka71yXqU1v4hFXT4AS5dvj4sf2iufYAfzc3rSHEa6Ow771gvgY3ceCNxgLbE9eIdBJWdECrPGV2nniAl-4WAsQqmmGCSx45YB-EN0lKvl-wZ6GoCJfWU4iA5jvlxuapGSCrtzh7F1ghRL35mYwWCG-nXE Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: 070bbe844e8945eca60ecc95244acd53 Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:49:08.040069 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:49:08.041538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/070bbe844e8945eca60ecc95244acd53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_070bbe844e8945eca60ecc95244acd53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/070bbe844e8945eca60ecc95244acd53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/070bbe844e8945eca60ecc95244acd53"}]}] Jun 14 19:49:08.041538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:49:08.041538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: 070bbe844e8945eca60ecc95244acd53 Jun 14 19:49:08.041538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:49:08.041538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeShelveTestJSON-1507149085-project Jun 14 19:49:08.041538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:49:08.041538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:49:08.041538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: f60ed90fb1a54339ac563bc649e98989 Jun 14 19:49:08.041538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1507149085-project Jun 14 19:49:08.041538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:49:08.041538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. Jun 14 19:49:08.041538 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '574d3163-12b7-4f68-9f90-445a0d1b0b8e'} Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:49:08.042277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. Jun 14 19:49:08.043591 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:08.045072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a23e1c6a-a928-4bbc-b906-471e3e2767d3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Returning 404 to user: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:49:08.045072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a23e1c6a-a928-4bbc-b906-471e3e2767d3 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "DELETE /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 404 len: 111 microversion: 2.20 time: 0.029142 Jun 14 19:49:08.045072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 426/873] 10.222.0.44 () {60 vars in 1279 bytes} [Tue Jun 14 19:49:08 2022] DELETE /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 14 19:49:08.050237 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d8dec2c7-7427-4f1b-ace2-e0176c2b4110 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:08.050839 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d8dec2c7-7427-4f1b-ace2-e0176c2b4110 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 574d3163-12b7-4f68-9f90-445a0d1b0b8e] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:08.059057 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d8dec2c7-7427-4f1b-ace2-e0176c2b4110 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:08.059509 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d8dec2c7-7427-4f1b-ace2-e0176c2b4110 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:08.060302 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d8dec2c7-7427-4f1b-ace2-e0176c2b4110 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:08.060816 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d8dec2c7-7427-4f1b-ace2-e0176c2b4110 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:08.074923 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-d8dec2c7-7427-4f1b-ace2-e0176c2b4110 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] HTTP exception thrown: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d8dec2c7-7427-4f1b-ace2-e0176c2b4110 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Request method failure captured: Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e HTTP/1.1 Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOSGSyi__YACn28acM6Q8Pka71yXqU1v4hFXT4AS5dvj4sf2iufYAfzc3rSHEa6Ow771gvgY3ceCNxgLbE9eIdBJWdECrPGV2nniAl-4WAsQqmmGCSx45YB-EN0lKvl-wZ6GoCJfWU4iA5jvlxuapGSCrtzh7F1ghRL35mYwWCG-nXE Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: 070bbe844e8945eca60ecc95244acd53 Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:49:08.076784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:49:08.078469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/070bbe844e8945eca60ecc95244acd53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_070bbe844e8945eca60ecc95244acd53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/070bbe844e8945eca60ecc95244acd53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/070bbe844e8945eca60ecc95244acd53"}]}] Jun 14 19:49:08.078469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:49:08.078469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: 070bbe844e8945eca60ecc95244acd53 Jun 14 19:49:08.078469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:49:08.078469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-AttachVolumeShelveTestJSON-1507149085-project Jun 14 19:49:08.078469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:49:08.078469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:49:08.078469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: f60ed90fb1a54339ac563bc649e98989 Jun 14 19:49:08.078469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1507149085-project Jun 14 19:49:08.078469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:49:08.078469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. Jun 14 19:49:08.078469 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': '574d3163-12b7-4f68-9f90-445a0d1b0b8e'} Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:49:08.079340 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. Jun 14 19:49:08.080762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:49:08.082395 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d8dec2c7-7427-4f1b-ace2-e0176c2b4110 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Returning 404 to user: Instance 574d3163-12b7-4f68-9f90-445a0d1b0b8e could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:49:08.082395 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d8dec2c7-7427-4f1b-ace2-e0176c2b4110 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e" status: 404 len: 111 microversion: 2.20 time: 0.031793 Jun 14 19:49:08.082395 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 448/874] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:49:08 2022] GET /compute/v2.1/servers/574d3163-12b7-4f68-9f90-445a0d1b0b8e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 14 19:49:08.313954 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-39148738-aa8a-451d-865b-398ba15b1f3a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:08.314478 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-39148738-aa8a-451d-865b-398ba15b1f3a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:08.320561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-39148738-aa8a-451d-865b-398ba15b1f3a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:08.321001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-39148738-aa8a-451d-865b-398ba15b1f3a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:08.321777 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-39148738-aa8a-451d-865b-398ba15b1f3a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:08.322199 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-39148738-aa8a-451d-865b-398ba15b1f3a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:08.457005 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-39148738-aa8a-451d-865b-398ba15b1f3a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:08.464668 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-39148738-aa8a-451d-865b-398ba15b1f3a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1319 microversion: 2.1 time: 0.154589 Jun 14 19:49:08.465224 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 427/875] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:08 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:09.218499 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-5f29783f-fd4b-4d35-8ba7-8f7bcff0a943 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:09.218499 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-5f29783f-fd4b-4d35-8ba7-8f7bcff0a943 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:09.222731 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5f29783f-fd4b-4d35-8ba7-8f7bcff0a943 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:09.223191 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5f29783f-fd4b-4d35-8ba7-8f7bcff0a943 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:09.223959 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5f29783f-fd4b-4d35-8ba7-8f7bcff0a943 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:09.224395 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5f29783f-fd4b-4d35-8ba7-8f7bcff0a943 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:09.237645 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-5f29783f-fd4b-4d35-8ba7-8f7bcff0a943 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] HTTP exception thrown: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-5f29783f-fd4b-4d35-8ba7-8f7bcff0a943 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Request method failure captured: Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: DELETE /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 HTTP/1.1 Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOSGSyi__YACn28acM6Q8Pka71yXqU1v4hFXT4AS5dvj4sf2iufYAfzc3rSHEa6Ow771gvgY3ceCNxgLbE9eIdBJWdECrPGV2nniAl-4WAsQqmmGCSx45YB-EN0lKvl-wZ6GoCJfWU4iA5jvlxuapGSCrtzh7F1ghRL35mYwWCG-nXE Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: 070bbe844e8945eca60ecc95244acd53 Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:49:09.239225 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:49:09.242187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/070bbe844e8945eca60ecc95244acd53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_070bbe844e8945eca60ecc95244acd53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/070bbe844e8945eca60ecc95244acd53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/070bbe844e8945eca60ecc95244acd53"}]}] Jun 14 19:49:09.242187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:49:09.242187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: 070bbe844e8945eca60ecc95244acd53 Jun 14 19:49:09.242187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:49:09.242187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-AttachVolumeShelveTestJSON-1507149085-project Jun 14 19:49:09.242187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:49:09.242187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:49:09.242187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: f60ed90fb1a54339ac563bc649e98989 Jun 14 19:49:09.242187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1507149085-project Jun 14 19:49:09.242187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:49:09.242187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. Jun 14 19:49:09.242187 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': '1f2d9ed3-941a-496c-b3c8-a9a5648cd846'} Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:49:09.243843 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. Jun 14 19:49:09.246321 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:49:09.248278 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-5f29783f-fd4b-4d35-8ba7-8f7bcff0a943 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Returning 404 to user: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:49:09.248278 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-5f29783f-fd4b-4d35-8ba7-8f7bcff0a943 tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 404 len: 111 microversion: 2.20 time: 0.030044 Jun 14 19:49:09.248278 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 449/876] 10.222.0.44 () {60 vars in 1279 bytes} [Tue Jun 14 19:49:09 2022] DELETE /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 14 19:49:09.249848 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-7fbbb5f7-445d-45dc-8a11-d730d9b8d5fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:09.250558 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-7fbbb5f7-445d-45dc-8a11-d730d9b8d5fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] [instance: 1f2d9ed3-941a-496c-b3c8-a9a5648cd846] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:09.261989 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7fbbb5f7-445d-45dc-8a11-d730d9b8d5fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:09.262738 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7fbbb5f7-445d-45dc-8a11-d730d9b8d5fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:09.263502 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7fbbb5f7-445d-45dc-8a11-d730d9b8d5fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:09.263928 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-7fbbb5f7-445d-45dc-8a11-d730d9b8d5fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:09.278846 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-7fbbb5f7-445d-45dc-8a11-d730d9b8d5fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] HTTP exception thrown: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-7fbbb5f7-445d-45dc-8a11-d730d9b8d5fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Request method failure captured: Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 HTTP/1.1 Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOSGSyi__YACn28acM6Q8Pka71yXqU1v4hFXT4AS5dvj4sf2iufYAfzc3rSHEa6Ow771gvgY3ceCNxgLbE9eIdBJWdECrPGV2nniAl-4WAsQqmmGCSx45YB-EN0lKvl-wZ6GoCJfWU4iA5jvlxuapGSCrtzh7F1ghRL35mYwWCG-nXE Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: 070bbe844e8945eca60ecc95244acd53 Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:49:09.280369 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:49:09.282003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/070bbe844e8945eca60ecc95244acd53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_070bbe844e8945eca60ecc95244acd53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/070bbe844e8945eca60ecc95244acd53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/070bbe844e8945eca60ecc95244acd53"}]}] Jun 14 19:49:09.282003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:49:09.282003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: 070bbe844e8945eca60ecc95244acd53 Jun 14 19:49:09.282003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1507149085 Jun 14 19:49:09.282003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-AttachVolumeShelveTestJSON-1507149085-project Jun 14 19:49:09.282003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:49:09.282003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:49:09.282003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: f60ed90fb1a54339ac563bc649e98989 Jun 14 19:49:09.282003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1507149085-project Jun 14 19:49:09.282003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:49:09.282003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. Jun 14 19:49:09.282003 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '1f2d9ed3-941a-496c-b3c8-a9a5648cd846'} Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:49:09.283064 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. Jun 14 19:49:09.284516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:09.285841 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-7fbbb5f7-445d-45dc-8a11-d730d9b8d5fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] Returning 404 to user: Instance 1f2d9ed3-941a-496c-b3c8-a9a5648cd846 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:49:09.285841 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-7fbbb5f7-445d-45dc-8a11-d730d9b8d5fc tempest-AttachVolumeShelveTestJSON-1507149085 tempest-AttachVolumeShelveTestJSON-1507149085-project] 10.222.0.44 "GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846" status: 404 len: 111 microversion: 2.20 time: 0.035778 Jun 14 19:49:09.285841 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 428/877] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 14 19:49:09 2022] GET /compute/v2.1/servers/1f2d9ed3-941a-496c-b3c8-a9a5648cd846 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 14 19:49:09.481766 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b0695efd-bb6d-436e-b481-6874bac9f74a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:09.482382 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b0695efd-bb6d-436e-b481-6874bac9f74a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:09.488277 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b0695efd-bb6d-436e-b481-6874bac9f74a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:09.488726 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b0695efd-bb6d-436e-b481-6874bac9f74a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:09.489517 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b0695efd-bb6d-436e-b481-6874bac9f74a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:09.489971 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b0695efd-bb6d-436e-b481-6874bac9f74a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:09.703570 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b0695efd-bb6d-436e-b481-6874bac9f74a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:09.711327 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b0695efd-bb6d-436e-b481-6874bac9f74a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1319 microversion: 2.1 time: 0.233560 Jun 14 19:49:09.711888 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 450/878] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:09 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:10.728400 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-5b9f5634-e021-430c-b627-1e84e071d765 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:10.729008 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-5b9f5634-e021-430c-b627-1e84e071d765 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:10.731546 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:10.737070 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5b9f5634-e021-430c-b627-1e84e071d765 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:10.737546 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5b9f5634-e021-430c-b627-1e84e071d765 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:10.738323 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5b9f5634-e021-430c-b627-1e84e071d765 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:10.738755 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5b9f5634-e021-430c-b627-1e84e071d765 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:10.872695 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-5b9f5634-e021-430c-b627-1e84e071d765 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:10.880171 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-5b9f5634-e021-430c-b627-1e84e071d765 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1319 microversion: 2.1 time: 0.155866 Jun 14 19:49:10.880740 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 429/879] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:10 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:11.898887 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-75d9084c-4bc6-4bf0-80ef-34a7a218317d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:11.899500 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-75d9084c-4bc6-4bf0-80ef-34a7a218317d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:11.901984 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:11.903021 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=6 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:11.908819 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-75d9084c-4bc6-4bf0-80ef-34a7a218317d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:11.909609 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-75d9084c-4bc6-4bf0-80ef-34a7a218317d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:11.910628 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-75d9084c-4bc6-4bf0-80ef-34a7a218317d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:11.911249 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-75d9084c-4bc6-4bf0-80ef-34a7a218317d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:12.097208 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-75d9084c-4bc6-4bf0-80ef-34a7a218317d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:12.106217 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-75d9084c-4bc6-4bf0-80ef-34a7a218317d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1319 microversion: 2.1 time: 0.212682 Jun 14 19:49:12.106898 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 451/880] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:11 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:13.123596 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-262c9fd9-7062-4702-ab78-0674ec77e2b6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:13.124213 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-262c9fd9-7062-4702-ab78-0674ec77e2b6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:13.126584 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:13.132676 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-262c9fd9-7062-4702-ab78-0674ec77e2b6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:13.133128 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-262c9fd9-7062-4702-ab78-0674ec77e2b6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:13.133924 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-262c9fd9-7062-4702-ab78-0674ec77e2b6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:13.134359 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-262c9fd9-7062-4702-ab78-0674ec77e2b6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:13.140192 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:13.279296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-262c9fd9-7062-4702-ab78-0674ec77e2b6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:13.291722 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-262c9fd9-7062-4702-ab78-0674ec77e2b6 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1319 microversion: 2.1 time: 0.171131 Jun 14 19:49:13.292886 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 430/881] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:13 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:14.308127 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c1d09099-9eba-484a-9c2f-fc1d76291dda tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:14.308738 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c1d09099-9eba-484a-9c2f-fc1d76291dda tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:14.311133 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:14.317237 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c1d09099-9eba-484a-9c2f-fc1d76291dda tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:14.317733 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c1d09099-9eba-484a-9c2f-fc1d76291dda tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:14.319489 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c1d09099-9eba-484a-9c2f-fc1d76291dda tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:14.319926 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c1d09099-9eba-484a-9c2f-fc1d76291dda tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:14.323591 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:14.417664 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-c4b52f41-d1d5-497b-9465-20e5478bffd1 req-478eec13-4ec8-4926-a876-5d3088e1f892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7493ef4-9e6b-4a6f-ac7e-885666b16626", "name": "network-vif-plugged", "status": "completed", "tag": "3e0dd0c0-1990-40e6-bc79-3c7f42bfca6a"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:49:14.426769 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-c4b52f41-d1d5-497b-9465-20e5478bffd1 req-478eec13-4ec8-4926-a876-5d3088e1f892 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:14.427470 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-c4b52f41-d1d5-497b-9465-20e5478bffd1 req-478eec13-4ec8-4926-a876-5d3088e1f892 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:14.442479 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-c4b52f41-d1d5-497b-9465-20e5478bffd1 req-478eec13-4ec8-4926-a876-5d3088e1f892 service nova] Creating event network-vif-plugged:3e0dd0c0-1990-40e6-bc79-3c7f42bfca6a for instance a7493ef4-9e6b-4a6f-ac7e-885666b16626 on hv-cinder-84580 Jun 14 19:49:14.449056 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-c4b52f41-d1d5-497b-9465-20e5478bffd1 req-478eec13-4ec8-4926-a876-5d3088e1f892 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034780 Jun 14 19:49:14.450277 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 431/882] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:49:14.486067 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c1d09099-9eba-484a-9c2f-fc1d76291dda tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:14.497700 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c1d09099-9eba-484a-9c2f-fc1d76291dda tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1319 microversion: 2.1 time: 0.193267 Jun 14 19:49:14.498601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 452/883] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:14 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:15.280894 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4c27e94e-df3a-4156-83e2-61432e90693c tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] Calling method '.version_select at 0x7f144b4013a0>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:15.335717 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4c27e94e-df3a-4156-83e2-61432e90693c tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/467b678d-a09a-485e-bd2b-4aa7624462a2" status: 200 len: 351 microversion: 2.1 time: 0.059428 Jun 14 19:49:15.336365 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 432/884] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 14 19:49:15 2022] GET /compute/v2.1/os-volumes/467b678d-a09a-485e-bd2b-4aa7624462a2 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:49:15.514997 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-52bf6db3-3526-46e3-8e08-084abc7b2e2f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:15.515614 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-52bf6db3-3526-46e3-8e08-084abc7b2e2f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:15.523138 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-52bf6db3-3526-46e3-8e08-084abc7b2e2f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:15.523663 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-52bf6db3-3526-46e3-8e08-084abc7b2e2f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:15.524570 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-52bf6db3-3526-46e3-8e08-084abc7b2e2f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:15.525020 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-52bf6db3-3526-46e3-8e08-084abc7b2e2f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:15.670998 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-52bf6db3-3526-46e3-8e08-084abc7b2e2f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:15.679496 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-52bf6db3-3526-46e3-8e08-084abc7b2e2f tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1319 microversion: 2.1 time: 0.168555 Jun 14 19:49:15.680304 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 453/885] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:15 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:16.696955 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-e202cb82-f6db-455f-bfc9-0bf2a8a9f790 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:16.697721 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-e202cb82-f6db-455f-bfc9-0bf2a8a9f790 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:16.703994 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e202cb82-f6db-455f-bfc9-0bf2a8a9f790 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:16.704445 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e202cb82-f6db-455f-bfc9-0bf2a8a9f790 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:16.705202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e202cb82-f6db-455f-bfc9-0bf2a8a9f790 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:16.705663 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-e202cb82-f6db-455f-bfc9-0bf2a8a9f790 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:16.832752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-e202cb82-f6db-455f-bfc9-0bf2a8a9f790 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:16.841073 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-e202cb82-f6db-455f-bfc9-0bf2a8a9f790 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1319 microversion: 2.1 time: 0.149067 Jun 14 19:49:16.841667 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 433/886] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:16 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:17.858364 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1134932b-d74f-4d8f-89e5-77efbd2c6a9d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:17.858973 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1134932b-d74f-4d8f-89e5-77efbd2c6a9d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:17.866178 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1134932b-d74f-4d8f-89e5-77efbd2c6a9d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:17.866480 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1134932b-d74f-4d8f-89e5-77efbd2c6a9d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:17.867239 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1134932b-d74f-4d8f-89e5-77efbd2c6a9d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:17.867672 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1134932b-d74f-4d8f-89e5-77efbd2c6a9d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:17.999798 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1134932b-d74f-4d8f-89e5-77efbd2c6a9d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:18.007175 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1134932b-d74f-4d8f-89e5-77efbd2c6a9d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1319 microversion: 2.1 time: 0.152655 Jun 14 19:49:18.007725 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 454/887] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:17 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:18.790907 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-45c38163-ae6f-49ec-b199-8e6f501f6ec1 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] Calling method '.version_select at 0x7f144b4018b0>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:18.840715 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-45c38163-ae6f-49ec-b199-8e6f501f6ec1 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/d3e78dad-e0b8-4985-b0f4-11cd9603cbcc" status: 200 len: 351 microversion: 2.1 time: 0.054070 Jun 14 19:49:18.841292 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 434/888] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 14 19:49:18 2022] GET /compute/v2.1/os-volumes/d3e78dad-e0b8-4985-b0f4-11cd9603cbcc => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:49:19.033136 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-fc7b1402-f5f0-4f60-8da4-172a46ae34f8 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:19.034664 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-fc7b1402-f5f0-4f60-8da4-172a46ae34f8 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:19.046768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fc7b1402-f5f0-4f60-8da4-172a46ae34f8 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:19.047257 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fc7b1402-f5f0-4f60-8da4-172a46ae34f8 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:19.048106 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fc7b1402-f5f0-4f60-8da4-172a46ae34f8 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:19.048558 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fc7b1402-f5f0-4f60-8da4-172a46ae34f8 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:19.191018 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-fc7b1402-f5f0-4f60-8da4-172a46ae34f8 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:19.198486 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-fc7b1402-f5f0-4f60-8da4-172a46ae34f8 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1507 microversion: 2.1 time: 0.178051 Jun 14 19:49:19.199045 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 455/889] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:19 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:19.215449 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-13ef2aee-df96-4d47-b093-97f7d74ec45a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6649ea40-5afb-45e2-9024-91dbb5a076a5", "device": "/dev/sdb"}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:49:19.216592 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-13ef2aee-df96-4d47-b093-97f7d74ec45a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:19.225687 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-13ef2aee-df96-4d47-b093-97f7d74ec45a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:19.226137 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-13ef2aee-df96-4d47-b093-97f7d74ec45a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:19.226896 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-13ef2aee-df96-4d47-b093-97f7d74ec45a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:19.227332 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-13ef2aee-df96-4d47-b093-97f7d74ec45a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:21.620985 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-13ef2aee-df96-4d47-b093-97f7d74ec45a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "POST /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.409396 Jun 14 19:49:21.622223 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 435/890] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 14 19:49:19 2022] POST /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626/os-volume_attachments => generated 194 bytes in 2411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:49:22.282846 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9fea5b3b-506d-4db1-8c35-6b96f7e0ccaf tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] Calling method '.version_select at 0x7f144ac1bf70>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:22.339580 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9fea5b3b-506d-4db1-8c35-6b96f7e0ccaf tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b20d7c2c-14ff-42e3-bf61-f92187245891" status: 200 len: 351 microversion: 2.1 time: 0.060620 Jun 14 19:49:22.343347 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 456/891] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 14 19:49:22 2022] GET /compute/v2.1/os-volumes/b20d7c2c-14ff-42e3-bf61-f92187245891 => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:49:22.353396 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-36c81145-dce9-486e-a4b8-9fe01acb9ad5 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] Calling method '.version_select at 0x7f144b4a6af0>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:22.435929 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-36c81145-dce9-486e-a4b8-9fe01acb9ad5 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088192 Jun 14 19:49:22.436494 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 436/892] 10.222.0.44 () {58 vars in 1133 bytes} [Tue Jun 14 19:49:22 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:22.449864 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4b5016ee-8933-4454-9950-133982b03ba0 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] Calling method '.version_select at 0x7f144acc8700>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:22.531533 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4b5016ee-8933-4454-9950-133982b03ba0 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085301 Jun 14 19:49:22.532115 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 457/893] 10.222.0.44 () {58 vars in 1148 bytes} [Tue Jun 14 19:49:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:49:22.544674 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6f64b47e-cf22-4e31-bc88-1d6c91fb5969 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] Calling method '.version_select at 0x7f144b401430>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:22.626001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6f64b47e-cf22-4e31-bc88-1d6c91fb5969 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.086068 Jun 14 19:49:22.626606 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 437/894] 10.222.0.44 () {58 vars in 1133 bytes} [Tue Jun 14 19:49:22 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:22.638346 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a95d1609-afb8-4d0c-96fe-651bcef01ef0 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] Calling method '.version_select at 0x7f144acc89d0>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:22.723233 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a95d1609-afb8-4d0c-96fe-651bcef01ef0 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088382 Jun 14 19:49:22.723927 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 458/895] 10.222.0.44 () {58 vars in 1166 bytes} [Tue Jun 14 19:49:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:49:22.737562 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4397a135-2cea-47bf-92d7-ee8767d17be8 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] Calling method '.version_select at 0x7f144b4019d0>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:22.825752 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4397a135-2cea-47bf-92d7-ee8767d17be8 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.092627 Jun 14 19:49:22.826488 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 438/896] 10.222.0.44 () {58 vars in 1169 bytes} [Tue Jun 14 19:49:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:49:22.838631 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-6f8f64a4-5ddd-48c3-9bb1-3124c7c4b9ab tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] Calling method '.version_select at 0x7f144ac824c0>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:22.937532 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-6f8f64a4-5ddd-48c3-9bb1-3124c7c4b9ab tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.102432 Jun 14 19:49:22.938685 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 459/897] 10.222.0.44 () {58 vars in 1154 bytes} [Tue Jun 14 19:49:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:22.950253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-2cde66ac-08a9-49f7-976d-88fb5e1fe0f3 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] Calling method '.version_select at 0x7f144b40d8b0>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:23.031306 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-2cde66ac-08a9-49f7-976d-88fb5e1fe0f3 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084815 Jun 14 19:49:23.031871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 439/898] 10.222.0.44 () {58 vars in 1187 bytes} [Tue Jun 14 19:49:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:49:23.044047 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-34d32f6a-d92b-4f1e-9ce0-244a09012746 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] Calling method '.version_select at 0x7f144acd84c0>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:23.123745 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-34d32f6a-d92b-4f1e-9ce0-244a09012746 tempest-VolumesTestJSON-490177792 tempest-VolumesTestJSON-490177792-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.083468 Jun 14 19:49:23.124309 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 460/899] 10.222.0.44 () {58 vars in 1154 bytes} [Tue Jun 14 19:49:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:42.024794 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=7 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:42.026132 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:42.033794 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4f410822-0350-439e-b269-4029ee3e59d4 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:42.033794 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4f410822-0350-439e-b269-4029ee3e59d4 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:42.043933 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4f410822-0350-439e-b269-4029ee3e59d4 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:42.044399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4f410822-0350-439e-b269-4029ee3e59d4 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:42.045227 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4f410822-0350-439e-b269-4029ee3e59d4 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:42.045822 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4f410822-0350-439e-b269-4029ee3e59d4 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:42.196681 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.objects.instance [None req-4f410822-0350-439e-b269-4029ee3e59d4 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lazy-loading 'services' on Instance uuid a7493ef4-9e6b-4a6f-ac7e-885666b16626 {{(pid=124069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:49:42.307109 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4f410822-0350-439e-b269-4029ee3e59d4 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626/os-volume_attachments/6649ea40-5afb-45e2-9024-91dbb5a076a5" status: 202 len: 0 microversion: 2.1 time: 0.283245 Jun 14 19:49:42.307710 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 440/900] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 14 19:49:42 2022] DELETE /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626/os-volume_attachments/6649ea40-5afb-45e2-9024-91dbb5a076a5 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:49:43.542400 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=7 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:43.543487 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=23 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:43.547654 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3b387382-c401-4ec3-94ca-b5916789029d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:43.548159 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3b387382-c401-4ec3-94ca-b5916789029d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:43.561969 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3b387382-c401-4ec3-94ca-b5916789029d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:43.563022 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3b387382-c401-4ec3-94ca-b5916789029d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:43.563936 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3b387382-c401-4ec3-94ca-b5916789029d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:43.564496 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3b387382-c401-4ec3-94ca-b5916789029d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:43.597612 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3b387382-c401-4ec3-94ca-b5916789029d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Going to try to terminate instance {{(pid=124068) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:49:43.706232 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3b387382-c401-4ec3-94ca-b5916789029d tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 204 len: 0 microversion: 2.1 time: 0.164174 Jun 14 19:49:43.708073 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 461/901] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:49:43 2022] DELETE /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:49:43.721084 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-919aa54f-56a1-474f-8415-f0853b2d62c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:43.722040 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-919aa54f-56a1-474f-8415-f0853b2d62c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:43.746692 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-919aa54f-56a1-474f-8415-f0853b2d62c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:43.748316 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-919aa54f-56a1-474f-8415-f0853b2d62c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:43.749163 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-919aa54f-56a1-474f-8415-f0853b2d62c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:43.752781 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-919aa54f-56a1-474f-8415-f0853b2d62c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:44.253674 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-919aa54f-56a1-474f-8415-f0853b2d62c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:44.276917 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-919aa54f-56a1-474f-8415-f0853b2d62c9 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1513 microversion: 2.1 time: 0.562377 Jun 14 19:49:44.277560 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 441/902] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:43 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1513 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:44.417875 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-937a86f0-505a-4af4-b389-743934126554 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:44.418678 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-937a86f0-505a-4af4-b389-743934126554 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:44.426542 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-73bf74de-8f06-419a-8879-509f24497556 req-f5654564-e27c-494a-a459-f806d0f5dd26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a0421fa-7df8-4d48-b112-fff79061f5ae", "tag": "04d8f989-9542-404e-a49a-add222e0ca49"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:49:44.428935 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-937a86f0-505a-4af4-b389-743934126554 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:44.430372 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-937a86f0-505a-4af4-b389-743934126554 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:44.436228 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-937a86f0-505a-4af4-b389-743934126554 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:44.437024 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-937a86f0-505a-4af4-b389-743934126554 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:44.449134 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-73bf74de-8f06-419a-8879-509f24497556 req-f5654564-e27c-494a-a459-f806d0f5dd26 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:44.449609 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-73bf74de-8f06-419a-8879-509f24497556 req-f5654564-e27c-494a-a459-f806d0f5dd26 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:44.474191 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-73bf74de-8f06-419a-8879-509f24497556 req-f5654564-e27c-494a-a459-f806d0f5dd26 service nova] Creating event network-changed:04d8f989-9542-404e-a49a-add222e0ca49 for instance 2a0421fa-7df8-4d48-b112-fff79061f5ae on hv-cinder-84580 Jun 14 19:49:44.490263 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-73bf74de-8f06-419a-8879-509f24497556 req-f5654564-e27c-494a-a459-f806d0f5dd26 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068918 Jun 14 19:49:44.495794 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 442/903] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:49:44.500530 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-937a86f0-505a-4af4-b389-743934126554 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Going to try to terminate instance {{(pid=124068) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:49:44.757608 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-937a86f0-505a-4af4-b389-743934126554 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 204 len: 0 microversion: 2.1 time: 0.343836 Jun 14 19:49:44.760711 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 462/904] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:49:44 2022] DELETE /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:49:44.783890 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-fea90fbc-680a-4698-984f-0bd4e218b202 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:44.785312 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-fea90fbc-680a-4698-984f-0bd4e218b202 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:44.803659 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fea90fbc-680a-4698-984f-0bd4e218b202 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:44.804512 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fea90fbc-680a-4698-984f-0bd4e218b202 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:44.805487 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fea90fbc-680a-4698-984f-0bd4e218b202 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:44.807627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-fea90fbc-680a-4698-984f-0bd4e218b202 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:45.121945 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-fea90fbc-680a-4698-984f-0bd4e218b202 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:45.132924 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-fea90fbc-680a-4698-984f-0bd4e218b202 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1570 microversion: 2.1 time: 0.364055 Jun 14 19:49:45.136057 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 443/905] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:44 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1570 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:45.295476 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-38abd157-3f96-4fe2-9db3-3e2753c8807a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:45.296496 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-38abd157-3f96-4fe2-9db3-3e2753c8807a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:45.307537 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-38abd157-3f96-4fe2-9db3-3e2753c8807a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:45.318481 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-38abd157-3f96-4fe2-9db3-3e2753c8807a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:45.319655 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-38abd157-3f96-4fe2-9db3-3e2753c8807a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:45.320273 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-38abd157-3f96-4fe2-9db3-3e2753c8807a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:45.704691 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-38abd157-3f96-4fe2-9db3-3e2753c8807a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:45.715596 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-38abd157-3f96-4fe2-9db3-3e2753c8807a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1513 microversion: 2.1 time: 0.424199 Jun 14 19:49:45.717327 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 463/906] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:45 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1513 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:46.154127 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-271ef604-01f5-4e08-a10f-78b6fe056882 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:46.154761 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-271ef604-01f5-4e08-a10f-78b6fe056882 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:46.164776 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-271ef604-01f5-4e08-a10f-78b6fe056882 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:46.165228 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-271ef604-01f5-4e08-a10f-78b6fe056882 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:46.168986 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-271ef604-01f5-4e08-a10f-78b6fe056882 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:46.169629 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-271ef604-01f5-4e08-a10f-78b6fe056882 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:46.587988 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-271ef604-01f5-4e08-a10f-78b6fe056882 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:46.601339 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-271ef604-01f5-4e08-a10f-78b6fe056882 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1570 microversion: 2.1 time: 0.451133 Jun 14 19:49:46.616346 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 444/907] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:46 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1570 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:46.735239 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c094c07b-dae1-4e82-872a-db32aea5a6f0 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:46.735860 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c094c07b-dae1-4e82-872a-db32aea5a6f0 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:46.750382 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c094c07b-dae1-4e82-872a-db32aea5a6f0 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:46.750515 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c094c07b-dae1-4e82-872a-db32aea5a6f0 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:46.758539 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c094c07b-dae1-4e82-872a-db32aea5a6f0 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:46.763337 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c094c07b-dae1-4e82-872a-db32aea5a6f0 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:47.468306 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c094c07b-dae1-4e82-872a-db32aea5a6f0 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:47.478845 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c094c07b-dae1-4e82-872a-db32aea5a6f0 tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1513 microversion: 2.1 time: 0.746496 Jun 14 19:49:47.478845 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 464/908] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:46 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1513 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:49:47.620541 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a4f80e96-1ae9-41a5-a11d-c676001c4c8c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:47.622573 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a4f80e96-1ae9-41a5-a11d-c676001c4c8c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:47.638892 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a4f80e96-1ae9-41a5-a11d-c676001c4c8c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:47.639349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a4f80e96-1ae9-41a5-a11d-c676001c4c8c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:47.648336 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a4f80e96-1ae9-41a5-a11d-c676001c4c8c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:47.654791 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a4f80e96-1ae9-41a5-a11d-c676001c4c8c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:48.065075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-e3071604-f313-4210-b889-027116dcb4a2 req-1665b08c-0d88-496f-9173-2dd63cf40ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7493ef4-9e6b-4a6f-ac7e-885666b16626", "name": "network-vif-deleted", "tag": "3e0dd0c0-1990-40e6-bc79-3c7f42bfca6a"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:49:48.123276 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-e3071604-f313-4210-b889-027116dcb4a2 req-1665b08c-0d88-496f-9173-2dd63cf40ec6 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:48.124927 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-e3071604-f313-4210-b889-027116dcb4a2 req-1665b08c-0d88-496f-9173-2dd63cf40ec6 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:48.154209 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-e3071604-f313-4210-b889-027116dcb4a2 req-1665b08c-0d88-496f-9173-2dd63cf40ec6 service nova] Creating event network-vif-deleted:3e0dd0c0-1990-40e6-bc79-3c7f42bfca6a for instance a7493ef4-9e6b-4a6f-ac7e-885666b16626 on hv-cinder-84580 Jun 14 19:49:48.159805 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-e3071604-f313-4210-b889-027116dcb4a2 req-1665b08c-0d88-496f-9173-2dd63cf40ec6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098207 Jun 14 19:49:48.160829 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 465/909] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:49:48.496419 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d738fa4b-4cf2-43cf-90c0-3e8720d97f4e tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:48.497138 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d738fa4b-4cf2-43cf-90c0-3e8720d97f4e tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:48.510581 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d738fa4b-4cf2-43cf-90c0-3e8720d97f4e tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:48.511044 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d738fa4b-4cf2-43cf-90c0-3e8720d97f4e tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:48.514248 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d738fa4b-4cf2-43cf-90c0-3e8720d97f4e tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:48.514781 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d738fa4b-4cf2-43cf-90c0-3e8720d97f4e tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:48.547946 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a4f80e96-1ae9-41a5-a11d-c676001c4c8c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fb1cff46d4e3e8e23f9a788cec9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780be61f7cb0429fbd97488f41a6b644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:48.572754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a4f80e96-1ae9-41a5-a11d-c676001c4c8c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 200 len: 1451 microversion: 2.1 time: 0.956194 Jun 14 19:49:48.573368 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 445/910] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:47 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 1451 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:49:48.625755 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d738fa4b-4cf2-43cf-90c0-3e8720d97f4e tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:48.626220 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d738fa4b-4cf2-43cf-90c0-3e8720d97f4e tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:48.629764 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.objects.instance [None req-d738fa4b-4cf2-43cf-90c0-3e8720d97f4e tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lazy-loading 'fault' on Instance uuid a7493ef4-9e6b-4a6f-ac7e-885666b16626 {{(pid=124068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:49:48.802785 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d738fa4b-4cf2-43cf-90c0-3e8720d97f4e tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2900dfb691734898a5fd1ac12207cebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a27fefe9ec41c09c01d67ec3d75683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:49:48.816204 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d738fa4b-4cf2-43cf-90c0-3e8720d97f4e tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 200 len: 1309 microversion: 2.1 time: 0.323888 Jun 14 19:49:48.816798 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 466/911] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:48 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 1309 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:49:49.596957 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-852b141d-0b2b-499f-ac2f-a5e1859e6003 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:49.598365 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-852b141d-0b2b-499f-ac2f-a5e1859e6003 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] [instance: 2a0421fa-7df8-4d48-b112-fff79061f5ae] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:49.608739 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-852b141d-0b2b-499f-ac2f-a5e1859e6003 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:49.609677 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-852b141d-0b2b-499f-ac2f-a5e1859e6003 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:49.610897 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-852b141d-0b2b-499f-ac2f-a5e1859e6003 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:49.611792 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-852b141d-0b2b-499f-ac2f-a5e1859e6003 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:49.640932 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-852b141d-0b2b-499f-ac2f-a5e1859e6003 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] HTTP exception thrown: Instance 2a0421fa-7df8-4d48-b112-fff79061f5ae could not be found. Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-852b141d-0b2b-499f-ac2f-a5e1859e6003 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Request method failure captured: Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae HTTP/1.1 Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOUjvhNYZfw5AxXmbowVDxCbnbUmPHcdvCrvw8hSSIKcs5ZomGcsrcRQnEu8YVe1egbu_q7vpbmPGl76famZeO3vk-kxczZkdCVt-1GuSaajDtTE1lHe-kH_ZoK3DJgGuEFFnMzXgzfsbTty6rK6S1S5vPVJSAVgsvTXKUuUcFY-tgc Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: 780be61f7cb0429fbd97488f41a6b644 Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-TestShelveInstance-139515457 Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:49:49.649754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:49:49.651179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/780be61f7cb0429fbd97488f41a6b644"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_780be61f7cb0429fbd97488f41a6b644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/780be61f7cb0429fbd97488f41a6b644"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/780be61f7cb0429fbd97488f41a6b644"}]}] Jun 14 19:49:49.651179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-TestShelveInstance-139515457 Jun 14 19:49:49.651179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: 780be61f7cb0429fbd97488f41a6b644 Jun 14 19:49:49.651179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-TestShelveInstance-139515457 Jun 14 19:49:49.651179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-TestShelveInstance-139515457-project Jun 14 19:49:49.651179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:49:49.651179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:49:49.651179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 7a5fb1cff46d4e3e8e23f9a788cec9ed Jun 14 19:49:49.651179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-TestShelveInstance-139515457-project Jun 14 19:49:49.651179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:49:49.651179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance 2a0421fa-7df8-4d48-b112-fff79061f5ae could not be found. Jun 14 19:49:49.651179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': '2a0421fa-7df8-4d48-b112-fff79061f5ae'} Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a0421fa-7df8-4d48-b112-fff79061f5ae could not be found. Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:49:49.652307 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a0421fa-7df8-4d48-b112-fff79061f5ae could not be found. Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a0421fa-7df8-4d48-b112-fff79061f5ae could not be found. Jun 14 19:49:49.653631 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:49:49.654821 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-852b141d-0b2b-499f-ac2f-a5e1859e6003 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Returning 404 to user: Instance 2a0421fa-7df8-4d48-b112-fff79061f5ae could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:49:49.654821 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-852b141d-0b2b-499f-ac2f-a5e1859e6003 tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae" status: 404 len: 111 microversion: 2.1 time: 0.061132 Jun 14 19:49:49.657911 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 446/912] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:49 2022] GET /compute/v2.1/servers/2a0421fa-7df8-4d48-b112-fff79061f5ae => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:49:49.834810 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9d50aeb6-d172-4b7e-aaad-f9ef4e0a9a0a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:49.836295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9d50aeb6-d172-4b7e-aaad-f9ef4e0a9a0a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] [instance: a7493ef4-9e6b-4a6f-ac7e-885666b16626] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:49:49.850823 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9d50aeb6-d172-4b7e-aaad-f9ef4e0a9a0a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:49.851603 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9d50aeb6-d172-4b7e-aaad-f9ef4e0a9a0a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:49.852824 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9d50aeb6-d172-4b7e-aaad-f9ef4e0a9a0a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:49.853467 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9d50aeb6-d172-4b7e-aaad-f9ef4e0a9a0a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:49.897710 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-9d50aeb6-d172-4b7e-aaad-f9ef4e0a9a0a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] HTTP exception thrown: Instance a7493ef4-9e6b-4a6f-ac7e-885666b16626 could not be found. Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9d50aeb6-d172-4b7e-aaad-f9ef4e0a9a0a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Request method failure captured: Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 HTTP/1.1 Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOXZs_MnG8DnNphfd4QssxcjWn22NShUEYTrhJBUebm55LU8pgrponTh-3y2g8XypHs2shqC5Jh-wfe70FR2SaPo03uirWY-hzP4N73Z_SMJSth0iYJrgLtVTexMAMC7cRSF_6MaEilW2t3-V2XI1EQaUPT8I4vOc5w-CaCa7FLtUgs Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: 35a27fefe9ec41c09c01d67ec3d75683 Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-VolumesSnapshotTestJSON-606613241 Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:49:49.899749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:49:49.901336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/35a27fefe9ec41c09c01d67ec3d75683"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_35a27fefe9ec41c09c01d67ec3d75683"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/35a27fefe9ec41c09c01d67ec3d75683"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/35a27fefe9ec41c09c01d67ec3d75683"}]}] Jun 14 19:49:49.901336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-VolumesSnapshotTestJSON-606613241 Jun 14 19:49:49.901336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: 35a27fefe9ec41c09c01d67ec3d75683 Jun 14 19:49:49.901336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-606613241 Jun 14 19:49:49.901336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-VolumesSnapshotTestJSON-606613241-project Jun 14 19:49:49.901336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:49:49.901336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:49:49.901336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 2900dfb691734898a5fd1ac12207cebf Jun 14 19:49:49.901336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-VolumesSnapshotTestJSON-606613241-project Jun 14 19:49:49.901336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:49:49.901336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance a7493ef4-9e6b-4a6f-ac7e-885666b16626 could not be found. Jun 14 19:49:49.901336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': 'a7493ef4-9e6b-4a6f-ac7e-885666b16626'} Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7493ef4-9e6b-4a6f-ac7e-885666b16626 could not be found. Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:49:49.902126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7493ef4-9e6b-4a6f-ac7e-885666b16626 could not be found. Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7493ef4-9e6b-4a6f-ac7e-885666b16626 could not be found. Jun 14 19:49:49.903669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:49:49.910063 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9d50aeb6-d172-4b7e-aaad-f9ef4e0a9a0a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] Returning 404 to user: Instance a7493ef4-9e6b-4a6f-ac7e-885666b16626 could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:49:49.911533 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9d50aeb6-d172-4b7e-aaad-f9ef4e0a9a0a tempest-VolumesSnapshotTestJSON-606613241 tempest-VolumesSnapshotTestJSON-606613241-project] 10.222.0.44 "GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626" status: 404 len: 111 microversion: 2.1 time: 0.080965 Jun 14 19:49:49.913539 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 467/913] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:49:49 2022] GET /compute/v2.1/servers/a7493ef4-9e6b-4a6f-ac7e-885666b16626 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:49:49.944342 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6c55d623-deb4-4f2b-9cce-c199b701c28c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] Calling method '.version_select at 0x7f144b45faf0>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:49:49.986019 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6c55d623-deb4-4f2b-9cce-c199b701c28c tempest-TestShelveInstance-139515457 tempest-TestShelveInstance-139515457-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1117510646" status: 202 len: 0 microversion: 2.1 time: 0.047258 Jun 14 19:49:49.987703 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 447/914] 10.222.0.44 () {58 vars in 1253 bytes} [Tue Jun 14 19:49:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1117510646 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:49:50.181797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-d8014d0b-8e26-47b3-98c1-dbb07cd0240e req-3494340c-31df-4f8a-aa88-ed4f9621c7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0421fa-7df8-4d48-b112-fff79061f5ae", "name": "network-vif-deleted", "tag": "04d8f989-9542-404e-a49a-add222e0ca49"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:49:50.194610 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-d8014d0b-8e26-47b3-98c1-dbb07cd0240e req-3494340c-31df-4f8a-aa88-ed4f9621c7c1 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:49:50.197153 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-d8014d0b-8e26-47b3-98c1-dbb07cd0240e req-3494340c-31df-4f8a-aa88-ed4f9621c7c1 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:49:50.223026 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-d8014d0b-8e26-47b3-98c1-dbb07cd0240e req-3494340c-31df-4f8a-aa88-ed4f9621c7c1 service nova] Creating event network-vif-deleted:04d8f989-9542-404e-a49a-add222e0ca49 for instance 2a0421fa-7df8-4d48-b112-fff79061f5ae on hv-cinder-84580 Jun 14 19:49:50.236745 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-d8014d0b-8e26-47b3-98c1-dbb07cd0240e req-3494340c-31df-4f8a-aa88-ed4f9621c7c1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058192 Jun 14 19:49:50.238262 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 468/915] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:50:11.220180 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d98adbc0-8639-4b6a-ba57-9df1bbee87e6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Action: 'create', calling method: .version_select at 0x7f144b43d280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1830863092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYBIx19PFO5kuwFG/gB70jeU+LJWa805rCzXJTHK6tfpTR7NhqnGFi/2ZQVbbF8UCTs6xoT7sOto0rqKYjIebH2/e9LFqlOtvbOnsrd1ORx2T7KhJYvS6uiB+VPi+81cA=="}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:50:11.232733 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:11.233415 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:11.253965 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-d98adbc0-8639-4b6a-ba57-9df1bbee87e6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Getting quotas for project a9af0b38d9fa4db0bfd12c0d1b51b12f. Resources: {'key_pairs'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:50:11.260081 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-d98adbc0-8639-4b6a-ba57-9df1bbee87e6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Getting quotas for user f2d3d11f92e3400c9ec8f35677a44198 and project a9af0b38d9fa4db0bfd12c0d1b51b12f. Resources: {'key_pairs'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:50:11.289709 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d98adbc0-8639-4b6a-ba57-9df1bbee87e6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.074255 Jun 14 19:50:11.290377 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 448/916] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 14 19:50:11 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:50:11.414473 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:11.415291 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:11.420075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2038031405", "imageRef": "b21fd584-754d-4d31-9867-e179c392c623", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1830863092", "networks": [{"uuid": "70d0da1d-056b-4b8a-9f33-02c7eb6b5f64"}]}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:50:11.480522 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.network.neutron [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] validate_networks() for [('70d0da1d-056b-4b8a-9f33-02c7eb6b5f64', None, None, None, None, None)] {{(pid=124068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:50:12.153628 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Flavor limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:50:12.154049 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Image limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:50:12.154573 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Flavor pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:50:12.154964 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Image pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:50:12.155395 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:50:12.164814 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:12.165547 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:12.166251 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:12.166716 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:12.193207 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Getting quotas for project a9af0b38d9fa4db0bfd12c0d1b51b12f. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:50:12.199888 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Getting quotas for user f2d3d11f92e3400c9ec8f35677a44198 and project a9af0b38d9fa4db0bfd12c0d1b51b12f. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:50:12.212696 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Going to run 1 instances... {{(pid=124068) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:50:12.215278 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b21fd584-754d-4d31-9867-e179c392c623',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:50:12.271531 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3e90e25b-db1d-4c5e-9d41-154452962313 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.858953 Jun 14 19:50:12.272387 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 469/917] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:50:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:50:12.282849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-743649d3-6a5a-4c02-bb92-f042eb94c125 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:12.283461 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-743649d3-6a5a-4c02-bb92-f042eb94c125 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:12.391041 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-743649d3-6a5a-4c02-bb92-f042eb94c125 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:12.398961 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-743649d3-6a5a-4c02-bb92-f042eb94c125 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1259 microversion: 2.1 time: 0.120482 Jun 14 19:50:12.408739 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 449/918] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:12 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1259 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:50:13.417190 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a570cab3-9f7d-4f4e-a3c5-f4425dd05822 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:13.417814 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a570cab3-9f7d-4f4e-a3c5-f4425dd05822 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:13.432847 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a570cab3-9f7d-4f4e-a3c5-f4425dd05822 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:13.433270 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a570cab3-9f7d-4f4e-a3c5-f4425dd05822 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:13.434088 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a570cab3-9f7d-4f4e-a3c5-f4425dd05822 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:13.434525 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-a570cab3-9f7d-4f4e-a3c5-f4425dd05822 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:13.546772 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a570cab3-9f7d-4f4e-a3c5-f4425dd05822 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:13.556286 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a570cab3-9f7d-4f4e-a3c5-f4425dd05822 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1263 microversion: 2.1 time: 0.143398 Jun 14 19:50:13.557508 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 470/919] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:13 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1263 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:14.574446 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6cfb550e-a2ca-4dcb-835c-2277b3c7e0bd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:14.575655 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-6cfb550e-a2ca-4dcb-835c-2277b3c7e0bd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:14.583672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6cfb550e-a2ca-4dcb-835c-2277b3c7e0bd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:14.584357 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6cfb550e-a2ca-4dcb-835c-2277b3c7e0bd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:14.586835 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6cfb550e-a2ca-4dcb-835c-2277b3c7e0bd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:14.590102 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6cfb550e-a2ca-4dcb-835c-2277b3c7e0bd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:14.803759 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-6cfb550e-a2ca-4dcb-835c-2277b3c7e0bd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:14.815159 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6cfb550e-a2ca-4dcb-835c-2277b3c7e0bd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1255 microversion: 2.1 time: 0.244378 Jun 14 19:50:14.825158 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 450/920] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:14 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1255 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:15.834582 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-6bf6a9aa-ab56-46c4-ac62-27aa351ad378 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:15.835597 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-6bf6a9aa-ab56-46c4-ac62-27aa351ad378 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:15.854391 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6bf6a9aa-ab56-46c4-ac62-27aa351ad378 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:15.864796 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6bf6a9aa-ab56-46c4-ac62-27aa351ad378 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:15.867487 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6bf6a9aa-ab56-46c4-ac62-27aa351ad378 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:15.871705 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6bf6a9aa-ab56-46c4-ac62-27aa351ad378 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:16.103386 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-6bf6a9aa-ab56-46c4-ac62-27aa351ad378 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:16.121628 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-6bf6a9aa-ab56-46c4-ac62-27aa351ad378 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1317 microversion: 2.1 time: 0.291824 Jun 14 19:50:16.122390 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 471/921] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:15 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:17.142266 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-597d7a03-3fac-4158-82db-257c022fa15a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:17.144952 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-597d7a03-3fac-4158-82db-257c022fa15a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:17.162617 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-597d7a03-3fac-4158-82db-257c022fa15a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:17.163280 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-597d7a03-3fac-4158-82db-257c022fa15a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:17.167091 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-597d7a03-3fac-4158-82db-257c022fa15a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:17.167947 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-597d7a03-3fac-4158-82db-257c022fa15a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:17.606987 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-597d7a03-3fac-4158-82db-257c022fa15a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:17.630893 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-597d7a03-3fac-4158-82db-257c022fa15a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1359 microversion: 2.1 time: 0.492742 Jun 14 19:50:17.633846 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 451/922] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:17 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1359 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:17.877230 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 19:50:17.877512 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Tue Jun 14 19:50:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 19:50:18.370451 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c0344863-b4c1-436c-8bac-3b552e542260 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Action: 'create', calling method: .version_select at 0x7f144acc8160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1706851958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPq6mm/YG1RyuaiW0TdyQR7kfxH76yO8wy/xWGjQm40VqfeCfayvDKTVdPMAoRmAmIvqdXu0nOpTbUq6VGQj2QNd+EqBTqvTrEMeAFZzPY+hxF8v298eVyzpJsRcXYnag=="}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:50:18.410072 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-c0344863-b4c1-436c-8bac-3b552e542260 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Getting quotas for project b0b8f372dfc54511a3f8c77baaa4f39a. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:50:18.414544 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-c0344863-b4c1-436c-8bac-3b552e542260 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Getting quotas for user 10f209080b9745d0a13f60ce5e1ca7df and project b0b8f372dfc54511a3f8c77baaa4f39a. Resources: {'key_pairs'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:50:18.478636 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c0344863-b4c1-436c-8bac-3b552e542260 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.565493 Jun 14 19:50:18.485762 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 472/923] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 14 19:50:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:50:18.652092 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-0c5311ea-c354-4295-b322-7c80f0fbd8d6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:18.652995 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-0c5311ea-c354-4295-b322-7c80f0fbd8d6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:18.682609 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c5311ea-c354-4295-b322-7c80f0fbd8d6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:18.691834 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c5311ea-c354-4295-b322-7c80f0fbd8d6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:18.694319 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c5311ea-c354-4295-b322-7c80f0fbd8d6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:18.702054 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0c5311ea-c354-4295-b322-7c80f0fbd8d6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:19.017096 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-0c5311ea-c354-4295-b322-7c80f0fbd8d6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:19.031515 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-0c5311ea-c354-4295-b322-7c80f0fbd8d6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1359 microversion: 2.1 time: 0.382563 Jun 14 19:50:19.035185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 452/924] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:18 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1359 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:19.114068 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-51a3242c-48b8-427a-a12e-670a071cd10d req-2e01d4db-b08d-4178-89a3-4be67ba3a77d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e138df4-7be3-4669-9687-d1458a243dc0", "tag": "1f4d48ec-b2f5-4b1d-a657-de6c50297a2b"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:50:19.131738 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-51a3242c-48b8-427a-a12e-670a071cd10d req-2e01d4db-b08d-4178-89a3-4be67ba3a77d service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:19.146605 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-51a3242c-48b8-427a-a12e-670a071cd10d req-2e01d4db-b08d-4178-89a3-4be67ba3a77d service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:19.178243 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-51a3242c-48b8-427a-a12e-670a071cd10d req-2e01d4db-b08d-4178-89a3-4be67ba3a77d service nova] Creating event network-changed:1f4d48ec-b2f5-4b1d-a657-de6c50297a2b for instance 8e138df4-7be3-4669-9687-d1458a243dc0 on hv-cinder-84580 Jun 14 19:50:19.196376 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-51a3242c-48b8-427a-a12e-670a071cd10d req-2e01d4db-b08d-4178-89a3-4be67ba3a77d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085775 Jun 14 19:50:19.201564 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 473/925] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:50:20.053193 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-0e9761b8-8b95-4e64-950c-46d4c81f392e tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:20.054567 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-0e9761b8-8b95-4e64-950c-46d4c81f392e tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:20.083076 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0e9761b8-8b95-4e64-950c-46d4c81f392e tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:20.087600 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0e9761b8-8b95-4e64-950c-46d4c81f392e tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:20.090020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0e9761b8-8b95-4e64-950c-46d4c81f392e tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:20.094067 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-0e9761b8-8b95-4e64-950c-46d4c81f392e tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:20.571253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-0e9761b8-8b95-4e64-950c-46d4c81f392e tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:20.588189 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-0e9761b8-8b95-4e64-950c-46d4c81f392e tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1359 microversion: 2.1 time: 0.539925 Jun 14 19:50:20.592836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 453/926] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:20 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1359 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:21.612439 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4c76b4b5-caa4-4d4d-b231-7741d5d01168 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:21.614459 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4c76b4b5-caa4-4d4d-b231-7741d5d01168 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:21.628254 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4c76b4b5-caa4-4d4d-b231-7741d5d01168 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:21.633965 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4c76b4b5-caa4-4d4d-b231-7741d5d01168 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:21.635553 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4c76b4b5-caa4-4d4d-b231-7741d5d01168 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:21.636226 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4c76b4b5-caa4-4d4d-b231-7741d5d01168 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:21.969978 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4c76b4b5-caa4-4d4d-b231-7741d5d01168 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:21.994003 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4c76b4b5-caa4-4d4d-b231-7741d5d01168 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1359 microversion: 2.1 time: 0.385670 Jun 14 19:50:22.004704 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 474/927] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:21 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1359 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:23.013245 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c7eea433-82fd-46a4-bdf9-d00741fe0ab5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:23.013812 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c7eea433-82fd-46a4-bdf9-d00741fe0ab5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:23.020867 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=6 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:23.026844 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c7eea433-82fd-46a4-bdf9-d00741fe0ab5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:23.027615 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c7eea433-82fd-46a4-bdf9-d00741fe0ab5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:23.028620 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c7eea433-82fd-46a4-bdf9-d00741fe0ab5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:23.029350 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c7eea433-82fd-46a4-bdf9-d00741fe0ab5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:23.353970 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c7eea433-82fd-46a4-bdf9-d00741fe0ab5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:23.365582 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c7eea433-82fd-46a4-bdf9-d00741fe0ab5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1359 microversion: 2.1 time: 0.355945 Jun 14 19:50:23.366318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 454/928] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:23 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1359 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:24.385328 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1a0ff1ea-7457-4bc5-a3da-d7ec39270f4a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:24.386812 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1a0ff1ea-7457-4bc5-a3da-d7ec39270f4a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:24.389059 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:24.412031 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1a0ff1ea-7457-4bc5-a3da-d7ec39270f4a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:24.413000 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1a0ff1ea-7457-4bc5-a3da-d7ec39270f4a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:24.414043 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1a0ff1ea-7457-4bc5-a3da-d7ec39270f4a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:24.414818 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1a0ff1ea-7457-4bc5-a3da-d7ec39270f4a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:24.861768 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1a0ff1ea-7457-4bc5-a3da-d7ec39270f4a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:24.878474 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1a0ff1ea-7457-4bc5-a3da-d7ec39270f4a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1359 microversion: 2.1 time: 0.496535 Jun 14 19:50:24.879540 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 475/929] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:24 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1359 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:25.897209 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b16f735f-0f6a-4f27-9174-50b23fde2bdd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:25.897844 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b16f735f-0f6a-4f27-9174-50b23fde2bdd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:25.904530 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b16f735f-0f6a-4f27-9174-50b23fde2bdd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:25.905020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b16f735f-0f6a-4f27-9174-50b23fde2bdd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:25.905823 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b16f735f-0f6a-4f27-9174-50b23fde2bdd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:25.906256 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b16f735f-0f6a-4f27-9174-50b23fde2bdd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:26.045287 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-b16f735f-0f6a-4f27-9174-50b23fde2bdd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:26.053637 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b16f735f-0f6a-4f27-9174-50b23fde2bdd tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1359 microversion: 2.1 time: 0.161066 Jun 14 19:50:26.054214 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 455/930] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:25 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:27.070963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-010af43b-d89a-4c9d-a1c4-5a29dc370e66 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:27.071612 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-010af43b-d89a-4c9d-a1c4-5a29dc370e66 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:27.078232 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-010af43b-d89a-4c9d-a1c4-5a29dc370e66 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:27.078688 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-010af43b-d89a-4c9d-a1c4-5a29dc370e66 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:27.079447 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-010af43b-d89a-4c9d-a1c4-5a29dc370e66 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:27.079881 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-010af43b-d89a-4c9d-a1c4-5a29dc370e66 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:27.211159 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-010af43b-d89a-4c9d-a1c4-5a29dc370e66 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:27.218392 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-010af43b-d89a-4c9d-a1c4-5a29dc370e66 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1359 microversion: 2.1 time: 0.151290 Jun 14 19:50:27.218936 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 476/931] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:27 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:28.236202 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-92ca3d07-c93e-4445-b56a-ffc757ebcaae tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:28.236829 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-92ca3d07-c93e-4445-b56a-ffc757ebcaae tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:28.243759 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-92ca3d07-c93e-4445-b56a-ffc757ebcaae tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:28.244258 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-92ca3d07-c93e-4445-b56a-ffc757ebcaae tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:28.245148 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-92ca3d07-c93e-4445-b56a-ffc757ebcaae tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:28.245614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-92ca3d07-c93e-4445-b56a-ffc757ebcaae tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:28.396842 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-92ca3d07-c93e-4445-b56a-ffc757ebcaae tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:28.405052 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-92ca3d07-c93e-4445-b56a-ffc757ebcaae tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1359 microversion: 2.1 time: 0.172866 Jun 14 19:50:28.405675 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 456/932] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:28 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:29.423951 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1b73054d-3214-4076-8276-83f774293ce1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:29.424761 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1b73054d-3214-4076-8276-83f774293ce1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:29.428051 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=10 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:29.433837 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1b73054d-3214-4076-8276-83f774293ce1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:29.434295 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1b73054d-3214-4076-8276-83f774293ce1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:29.435069 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1b73054d-3214-4076-8276-83f774293ce1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:29.435507 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1b73054d-3214-4076-8276-83f774293ce1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:29.584470 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1b73054d-3214-4076-8276-83f774293ce1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:29.592805 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1b73054d-3214-4076-8276-83f774293ce1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1359 microversion: 2.1 time: 0.173900 Jun 14 19:50:29.593477 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 477/933] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:29 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:30.610747 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-628727c0-942f-4f44-b267-2ca64f515c06 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:30.611420 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-628727c0-942f-4f44-b267-2ca64f515c06 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:30.620084 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-628727c0-942f-4f44-b267-2ca64f515c06 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:30.620783 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-628727c0-942f-4f44-b267-2ca64f515c06 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:30.621827 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-628727c0-942f-4f44-b267-2ca64f515c06 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:30.622261 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-628727c0-942f-4f44-b267-2ca64f515c06 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:30.790679 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-628727c0-942f-4f44-b267-2ca64f515c06 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:30.798322 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-628727c0-942f-4f44-b267-2ca64f515c06 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1359 microversion: 2.1 time: 0.191671 Jun 14 19:50:30.798875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 457/934] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:30 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:31.815878 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-24febf24-7fc6-48d7-9aca-dc10460f61d1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:31.816722 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-24febf24-7fc6-48d7-9aca-dc10460f61d1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:31.826451 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-24febf24-7fc6-48d7-9aca-dc10460f61d1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:31.827169 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-24febf24-7fc6-48d7-9aca-dc10460f61d1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:31.827974 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-24febf24-7fc6-48d7-9aca-dc10460f61d1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:31.828411 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-24febf24-7fc6-48d7-9aca-dc10460f61d1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:32.012987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-24febf24-7fc6-48d7-9aca-dc10460f61d1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:32.021242 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-24febf24-7fc6-48d7-9aca-dc10460f61d1 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1359 microversion: 2.1 time: 0.209084 Jun 14 19:50:32.022074 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 478/935] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:31 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:32.649344 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-1c2d9cfe-fb17-4e86-93bd-ab56d5d62c0b req-2649a526-7cc7-4b65-b6ab-d4e0e6184a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e138df4-7be3-4669-9687-d1458a243dc0", "name": "network-vif-plugged", "status": "completed", "tag": "1f4d48ec-b2f5-4b1d-a657-de6c50297a2b"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:50:32.663274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-1c2d9cfe-fb17-4e86-93bd-ab56d5d62c0b req-2649a526-7cc7-4b65-b6ab-d4e0e6184a5c service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:32.664386 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-1c2d9cfe-fb17-4e86-93bd-ab56d5d62c0b req-2649a526-7cc7-4b65-b6ab-d4e0e6184a5c service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:32.677838 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-1c2d9cfe-fb17-4e86-93bd-ab56d5d62c0b req-2649a526-7cc7-4b65-b6ab-d4e0e6184a5c service nova] Creating event network-vif-plugged:1f4d48ec-b2f5-4b1d-a657-de6c50297a2b for instance 8e138df4-7be3-4669-9687-d1458a243dc0 on hv-cinder-84580 Jun 14 19:50:32.683240 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-1c2d9cfe-fb17-4e86-93bd-ab56d5d62c0b req-2649a526-7cc7-4b65-b6ab-d4e0e6184a5c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038750 Jun 14 19:50:32.684105 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 458/936] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:50:33.038220 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-fb6a1981-69d4-42d6-827b-15f519e3b195 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:33.038828 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-fb6a1981-69d4-42d6-827b-15f519e3b195 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:33.045231 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fb6a1981-69d4-42d6-827b-15f519e3b195 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:33.045707 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fb6a1981-69d4-42d6-827b-15f519e3b195 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:33.046456 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fb6a1981-69d4-42d6-827b-15f519e3b195 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:33.046882 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fb6a1981-69d4-42d6-827b-15f519e3b195 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:33.178302 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-fb6a1981-69d4-42d6-827b-15f519e3b195 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:33.186019 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-fb6a1981-69d4-42d6-827b-15f519e3b195 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1359 microversion: 2.1 time: 0.151630 Jun 14 19:50:33.186569 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 479/937] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:33 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:34.204651 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-481b31cc-1d66-46f2-9274-835c26567033 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:34.205568 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-481b31cc-1d66-46f2-9274-835c26567033 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:34.211695 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-481b31cc-1d66-46f2-9274-835c26567033 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:34.212147 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-481b31cc-1d66-46f2-9274-835c26567033 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:34.212909 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-481b31cc-1d66-46f2-9274-835c26567033 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:34.213343 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-481b31cc-1d66-46f2-9274-835c26567033 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:34.350877 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-481b31cc-1d66-46f2-9274-835c26567033 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:34.358844 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-481b31cc-1d66-46f2-9274-835c26567033 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1359 microversion: 2.1 time: 0.159018 Jun 14 19:50:34.359401 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 459/938] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:34 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:35.375967 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-6bd254d8-75b0-46d1-b3d1-9badc31f52a6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:35.376582 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-6bd254d8-75b0-46d1-b3d1-9badc31f52a6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:35.383746 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6bd254d8-75b0-46d1-b3d1-9badc31f52a6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:35.384199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6bd254d8-75b0-46d1-b3d1-9badc31f52a6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:35.384963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6bd254d8-75b0-46d1-b3d1-9badc31f52a6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:35.385421 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6bd254d8-75b0-46d1-b3d1-9badc31f52a6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:35.528378 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-6bd254d8-75b0-46d1-b3d1-9badc31f52a6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:35.535860 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-6bd254d8-75b0-46d1-b3d1-9badc31f52a6 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1548 microversion: 2.1 time: 0.163749 Jun 14 19:50:35.536416 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 480/939] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:35 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:35.551606 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d99f7432-361a-4fe2-b28b-7482ec3ef2aa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:35.552743 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d99f7432-361a-4fe2-b28b-7482ec3ef2aa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:35.560122 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d99f7432-361a-4fe2-b28b-7482ec3ef2aa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:35.560585 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d99f7432-361a-4fe2-b28b-7482ec3ef2aa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:35.561366 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d99f7432-361a-4fe2-b28b-7482ec3ef2aa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:35.561859 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d99f7432-361a-4fe2-b28b-7482ec3ef2aa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:35.700155 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d99f7432-361a-4fe2-b28b-7482ec3ef2aa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:35.710297 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d99f7432-361a-4fe2-b28b-7482ec3ef2aa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1548 microversion: 2.1 time: 0.162412 Jun 14 19:50:35.711332 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 460/940] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:35 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:35.726445 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9c45d668-c881-4383-b9aa-77c35d80ebe8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:35.730117 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9c45d668-c881-4383-b9aa-77c35d80ebe8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:35.730882 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9c45d668-c881-4383-b9aa-77c35d80ebe8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Searching by: {'deleted': False, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f'} {{(pid=124068) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 14 19:50:35.738623 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c45d668-c881-4383-b9aa-77c35d80ebe8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:35.739075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c45d668-c881-4383-b9aa-77c35d80ebe8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:35.740452 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c45d668-c881-4383-b9aa-77c35d80ebe8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:35.740982 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9c45d668-c881-4383-b9aa-77c35d80ebe8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:35.830207 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.multi_cell_list [None req-9c45d668-c881-4383-b9aa-77c35d80ebe8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124068) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 14 19:50:35.925338 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9c45d668-c881-4383-b9aa-77c35d80ebe8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203248 Jun 14 19:50:35.925942 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 481/941] 10.222.0.44 () {58 vars in 1124 bytes} [Tue Jun 14 19:50:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:50:35.936627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8ae7c46a-1c62-4335-98d5-39558b2aa964 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:35.937240 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8ae7c46a-1c62-4335-98d5-39558b2aa964 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:35.943949 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8ae7c46a-1c62-4335-98d5-39558b2aa964 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:35.944394 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8ae7c46a-1c62-4335-98d5-39558b2aa964 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:35.945147 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8ae7c46a-1c62-4335-98d5-39558b2aa964 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:35.945758 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8ae7c46a-1c62-4335-98d5-39558b2aa964 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:36.075676 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8ae7c46a-1c62-4335-98d5-39558b2aa964 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:36.083221 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8ae7c46a-1c62-4335-98d5-39558b2aa964 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1548 microversion: 2.1 time: 0.150368 Jun 14 19:50:36.084661 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 461/942] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:35 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:37.601207 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d0c1eb37-ac24-4f8e-bf2d-aaa23ff4f83a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12855736-e14c-4a9d-99c9-0c304f48224e"}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:50:37.602288 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d0c1eb37-ac24-4f8e-bf2d-aaa23ff4f83a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:37.608358 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0c1eb37-ac24-4f8e-bf2d-aaa23ff4f83a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:37.608802 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0c1eb37-ac24-4f8e-bf2d-aaa23ff4f83a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:37.609578 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0c1eb37-ac24-4f8e-bf2d-aaa23ff4f83a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:37.610007 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0c1eb37-ac24-4f8e-bf2d-aaa23ff4f83a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:37.864853 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d0c1eb37-ac24-4f8e-bf2d-aaa23ff4f83a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "POST /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267646 Jun 14 19:50:37.865493 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 482/943] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 14 19:50:37 2022] POST /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:50:39.083034 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-488907830", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1706851958", "security_groups": [{"name": "tempest-secgroup-smoke-1919502732"}], "block_device_mapping_v2": [{"uuid": "fe140541-4414-4649-9dad-3101d9ac75cb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5f9bd32b-81b7-4de4-b011-9decc2484677"}]}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:50:39.202613 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.network.neutron [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] validate_networks() for [('5f9bd32b-81b7-4de4-b011-9decc2484677', None, None, None, None, None)] {{(pid=124069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:50:39.584087 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Flavor limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:50:39.584866 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Image limits 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:50:39.585769 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Flavor pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:50:39.586514 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Image pref 0:0:0 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:50:39.587268 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.virt.hardware [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:50:39.597079 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:39.597570 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:39.598370 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:39.598807 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:39.615378 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Getting quotas for project b0b8f372dfc54511a3f8c77baaa4f39a. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:50:39.619285 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.quota [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Getting quotas for user 10f209080b9745d0a13f60ce5e1ca7df and project b0b8f372dfc54511a3f8c77baaa4f39a. Resources: {'instances', 'ram', 'cores'} {{(pid=124069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:50:39.675977 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Going to run 1 instances... {{(pid=124069) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:50:39.678093 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe140541-4414-4649-9dad-3101d9ac75cb',volume_size=None,volume_type=None)] {{(pid=124069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:50:39.804388 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b61c12b1-48c2-4e32-be1f-243dd2ff0dca tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.725111 Jun 14 19:50:39.805032 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 462/944] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:50:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:50:39.816592 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-a86c3481-7294-4d43-8b89-51061f9a2eb1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:39.817293 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-a86c3481-7294-4d43-8b89-51061f9a2eb1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:39.874242 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-a86c3481-7294-4d43-8b89-51061f9a2eb1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:39.880917 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-a86c3481-7294-4d43-8b89-51061f9a2eb1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1094 microversion: 2.1 time: 0.069136 Jun 14 19:50:39.881763 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 483/945] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:39 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:40.899315 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-f44d5a6e-143f-4343-845b-a42a8bc063b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:40.899946 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-f44d5a6e-143f-4343-845b-a42a8bc063b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:40.908973 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f44d5a6e-143f-4343-845b-a42a8bc063b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:40.909471 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f44d5a6e-143f-4343-845b-a42a8bc063b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:40.910333 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f44d5a6e-143f-4343-845b-a42a8bc063b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:40.910773 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f44d5a6e-143f-4343-845b-a42a8bc063b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:40.979847 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-f44d5a6e-143f-4343-845b-a42a8bc063b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:40.988501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-f44d5a6e-143f-4343-845b-a42a8bc063b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1210 microversion: 2.1 time: 0.093621 Jun 14 19:50:40.989068 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 463/946] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:40 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:42.005958 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c32ef70b-5e8b-4be5-9fbe-ec6e726d52fa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:42.006715 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c32ef70b-5e8b-4be5-9fbe-ec6e726d52fa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:42.156247 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-50b4b013-2c1b-4eff-bdbf-0cbaa20b4d30 req-1cf3eace-e026-44ed-a57a-db1c33d81089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbde7130-9d05-4c60-bd6d-4b246459c4bc", "tag": "654d7ce2-229b-4415-aa73-ed1f8ea3e80f"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:50:42.165176 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:42.172154 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-50b4b013-2c1b-4eff-bdbf-0cbaa20b4d30 req-1cf3eace-e026-44ed-a57a-db1c33d81089 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:42.173012 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-50b4b013-2c1b-4eff-bdbf-0cbaa20b4d30 req-1cf3eace-e026-44ed-a57a-db1c33d81089 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:42.193657 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=77 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:42.195483 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-50b4b013-2c1b-4eff-bdbf-0cbaa20b4d30 req-1cf3eace-e026-44ed-a57a-db1c33d81089 service nova] Creating event network-changed:654d7ce2-229b-4415-aa73-ed1f8ea3e80f for instance cbde7130-9d05-4c60-bd6d-4b246459c4bc on hv-cinder-84580 Jun 14 19:50:42.202290 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-50b4b013-2c1b-4eff-bdbf-0cbaa20b4d30 req-1cf3eace-e026-44ed-a57a-db1c33d81089 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049682 Jun 14 19:50:42.203715 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 464/947] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:50:42.237484 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:42.239519 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c32ef70b-5e8b-4be5-9fbe-ec6e726d52fa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:42.240140 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c32ef70b-5e8b-4be5-9fbe-ec6e726d52fa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:42.241186 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c32ef70b-5e8b-4be5-9fbe-ec6e726d52fa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:42.241716 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c32ef70b-5e8b-4be5-9fbe-ec6e726d52fa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:42.245353 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:42.465868 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c32ef70b-5e8b-4be5-9fbe-ec6e726d52fa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:42.473573 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c32ef70b-5e8b-4be5-9fbe-ec6e726d52fa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1278 microversion: 2.1 time: 0.471762 Jun 14 19:50:42.474134 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 484/948] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:42 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1278 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:43.491361 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-f1b0d040-ad04-4faf-b0a9-06bccced8bb3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:43.492054 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-f1b0d040-ad04-4faf-b0a9-06bccced8bb3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:43.499002 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f1b0d040-ad04-4faf-b0a9-06bccced8bb3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:43.499443 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f1b0d040-ad04-4faf-b0a9-06bccced8bb3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:43.500197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f1b0d040-ad04-4faf-b0a9-06bccced8bb3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:43.500629 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f1b0d040-ad04-4faf-b0a9-06bccced8bb3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:43.631181 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-f1b0d040-ad04-4faf-b0a9-06bccced8bb3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:43.638592 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-f1b0d040-ad04-4faf-b0a9-06bccced8bb3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1278 microversion: 2.1 time: 0.151836 Jun 14 19:50:43.639147 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 465/949] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:43 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:44.374627 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-6547b69d-a5ab-4137-98e8-e70d4b7f9006 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:44.375238 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-6547b69d-a5ab-4137-98e8-e70d4b7f9006 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:44.382046 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6547b69d-a5ab-4137-98e8-e70d4b7f9006 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:44.382600 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6547b69d-a5ab-4137-98e8-e70d4b7f9006 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:44.383596 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6547b69d-a5ab-4137-98e8-e70d4b7f9006 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:44.384217 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6547b69d-a5ab-4137-98e8-e70d4b7f9006 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:44.517271 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-6547b69d-a5ab-4137-98e8-e70d4b7f9006 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:44.525533 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-6547b69d-a5ab-4137-98e8-e70d4b7f9006 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1594 microversion: 2.1 time: 0.154969 Jun 14 19:50:44.526082 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 485/950] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:44 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:44.656418 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-64a5ad29-9e74-4e15-9183-4cdf03943557 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:44.657028 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-64a5ad29-9e74-4e15-9183-4cdf03943557 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:44.663740 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-64a5ad29-9e74-4e15-9183-4cdf03943557 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:44.664268 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-64a5ad29-9e74-4e15-9183-4cdf03943557 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:44.665107 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-64a5ad29-9e74-4e15-9183-4cdf03943557 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:44.665754 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-64a5ad29-9e74-4e15-9183-4cdf03943557 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:44.875020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-64a5ad29-9e74-4e15-9183-4cdf03943557 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:44.882563 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-64a5ad29-9e74-4e15-9183-4cdf03943557 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1266 microversion: 2.1 time: 0.231174 Jun 14 19:50:44.883123 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 466/951] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:44 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:45.900037 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e38a80cc-fd36-4eea-8882-b3ff5a75f076 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:45.900637 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e38a80cc-fd36-4eea-8882-b3ff5a75f076 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:45.903077 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:45.908369 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e38a80cc-fd36-4eea-8882-b3ff5a75f076 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:45.908854 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e38a80cc-fd36-4eea-8882-b3ff5a75f076 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:45.909674 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e38a80cc-fd36-4eea-8882-b3ff5a75f076 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:45.910103 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e38a80cc-fd36-4eea-8882-b3ff5a75f076 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:46.044173 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-e38a80cc-fd36-4eea-8882-b3ff5a75f076 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:46.052264 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e38a80cc-fd36-4eea-8882-b3ff5a75f076 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1266 microversion: 2.1 time: 0.156096 Jun 14 19:50:46.052827 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 486/952] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:45 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:46.331826 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-0e4fb30e-1545-447a-93bd-c67dc3ba4dc8 req-f3c51899-a516-4a7a-ac44-91eea2fdbd9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e138df4-7be3-4669-9687-d1458a243dc0", "tag": "1f4d48ec-b2f5-4b1d-a657-de6c50297a2b"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:50:46.342666 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-0e4fb30e-1545-447a-93bd-c67dc3ba4dc8 req-f3c51899-a516-4a7a-ac44-91eea2fdbd9b service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:46.343118 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-0e4fb30e-1545-447a-93bd-c67dc3ba4dc8 req-f3c51899-a516-4a7a-ac44-91eea2fdbd9b service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:46.355021 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-0e4fb30e-1545-447a-93bd-c67dc3ba4dc8 req-f3c51899-a516-4a7a-ac44-91eea2fdbd9b service nova] Creating event network-changed:1f4d48ec-b2f5-4b1d-a657-de6c50297a2b for instance 8e138df4-7be3-4669-9687-d1458a243dc0 on hv-cinder-84580 Jun 14 19:50:46.361492 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-0e4fb30e-1545-447a-93bd-c67dc3ba4dc8 req-f3c51899-a516-4a7a-ac44-91eea2fdbd9b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033542 Jun 14 19:50:46.362745 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 467/953] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:50:47.069449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-51663fb0-8f56-4ed8-825e-7dcc17ab59a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:47.070219 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-51663fb0-8f56-4ed8-825e-7dcc17ab59a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:47.079871 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-51663fb0-8f56-4ed8-825e-7dcc17ab59a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:47.080905 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-51663fb0-8f56-4ed8-825e-7dcc17ab59a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:47.081946 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-51663fb0-8f56-4ed8-825e-7dcc17ab59a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:47.082800 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-51663fb0-8f56-4ed8-825e-7dcc17ab59a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:47.229038 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-51663fb0-8f56-4ed8-825e-7dcc17ab59a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:47.237071 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-51663fb0-8f56-4ed8-825e-7dcc17ab59a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1266 microversion: 2.1 time: 0.171979 Jun 14 19:50:47.247519 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 487/954] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:47 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:47.533941 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c1f65b76-4767-420f-80a3-bed3d294bf8b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-126110270"}} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:50:47.535450 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c1f65b76-4767-420f-80a3-bed3d294bf8b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:47.541805 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c1f65b76-4767-420f-80a3-bed3d294bf8b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:47.542443 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c1f65b76-4767-420f-80a3-bed3d294bf8b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:47.543939 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c1f65b76-4767-420f-80a3-bed3d294bf8b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:47.544375 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c1f65b76-4767-420f-80a3-bed3d294bf8b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:47.715884 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.network.security_group_api [None req-c1f65b76-4767-420f-80a3-bed3d294bf8b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Adding security group f1e053c2-5026-428f-88fa-439d68ad5083 to port 1f4d48ec-b2f5-4b1d-a657-de6c50297a2b Jun 14 19:50:48.057713 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c1f65b76-4767-420f-80a3-bed3d294bf8b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "POST /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/action" status: 202 len: 0 microversion: 2.1 time: 0.528728 Jun 14 19:50:48.065327 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 468/955] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 14 19:50:47 2022] POST /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:50:48.068648 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1c7d4685-d8e3-4730-96c6-198254d3c289 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:48.069272 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1c7d4685-d8e3-4730-96c6-198254d3c289 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:48.077846 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1c7d4685-d8e3-4730-96c6-198254d3c289 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:48.079555 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1c7d4685-d8e3-4730-96c6-198254d3c289 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:48.080533 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1c7d4685-d8e3-4730-96c6-198254d3c289 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:48.081203 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1c7d4685-d8e3-4730-96c6-198254d3c289 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:48.257346 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-be8a7afd-cba3-44bd-ba51-b833d02de0b2 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:48.259167 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-be8a7afd-cba3-44bd-ba51-b833d02de0b2 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:48.271532 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-be8a7afd-cba3-44bd-ba51-b833d02de0b2 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:48.271996 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-be8a7afd-cba3-44bd-ba51-b833d02de0b2 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:48.272797 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-be8a7afd-cba3-44bd-ba51-b833d02de0b2 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:48.273233 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-be8a7afd-cba3-44bd-ba51-b833d02de0b2 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:48.445332 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-be8a7afd-cba3-44bd-ba51-b833d02de0b2 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:48.458907 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-be8a7afd-cba3-44bd-ba51-b833d02de0b2 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1266 microversion: 2.1 time: 0.207882 Jun 14 19:50:48.460156 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 469/956] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:48 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:50:48.465345 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-7ec91c1a-4f8d-4b1e-8457-1675ddb9a6c5 req-622c3e43-0f85-4056-bf38-4503958133f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e138df4-7be3-4669-9687-d1458a243dc0", "tag": "1f4d48ec-b2f5-4b1d-a657-de6c50297a2b"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:50:48.474402 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-7ec91c1a-4f8d-4b1e-8457-1675ddb9a6c5 req-622c3e43-0f85-4056-bf38-4503958133f2 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:48.474875 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-7ec91c1a-4f8d-4b1e-8457-1675ddb9a6c5 req-622c3e43-0f85-4056-bf38-4503958133f2 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:48.487288 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-7ec91c1a-4f8d-4b1e-8457-1675ddb9a6c5 req-622c3e43-0f85-4056-bf38-4503958133f2 service nova] Creating event network-changed:1f4d48ec-b2f5-4b1d-a657-de6c50297a2b for instance 8e138df4-7be3-4669-9687-d1458a243dc0 on hv-cinder-84580 Jun 14 19:50:48.492072 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-7ec91c1a-4f8d-4b1e-8457-1675ddb9a6c5 req-622c3e43-0f85-4056-bf38-4503958133f2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030627 Jun 14 19:50:48.492883 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 470/957] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:50:48.515142 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1c7d4685-d8e3-4730-96c6-198254d3c289 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:48.523415 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1c7d4685-d8e3-4730-96c6-198254d3c289 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1759 microversion: 2.1 time: 0.458750 Jun 14 19:50:48.523970 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 488/958] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:48 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1759 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:50:49.476813 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9e24509f-4992-410d-bace-cde683290f4a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:49.479406 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9e24509f-4992-410d-bace-cde683290f4a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:49.485912 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9e24509f-4992-410d-bace-cde683290f4a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:49.486363 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9e24509f-4992-410d-bace-cde683290f4a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:49.487125 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9e24509f-4992-410d-bace-cde683290f4a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:49.487561 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9e24509f-4992-410d-bace-cde683290f4a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:49.606613 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:49.619426 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9e24509f-4992-410d-bace-cde683290f4a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:49.626087 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=6 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:49.628683 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9e24509f-4992-410d-bace-cde683290f4a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1266 microversion: 2.1 time: 0.156570 Jun 14 19:50:49.629234 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 471/959] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:49 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:50.647722 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-750dfda4-4128-45c2-90cb-0ff52f515aaa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:50.648412 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-750dfda4-4128-45c2-90cb-0ff52f515aaa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:50.650722 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:50.656182 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-750dfda4-4128-45c2-90cb-0ff52f515aaa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:50.656626 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-750dfda4-4128-45c2-90cb-0ff52f515aaa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:50.657416 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-750dfda4-4128-45c2-90cb-0ff52f515aaa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:50.657852 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-750dfda4-4128-45c2-90cb-0ff52f515aaa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:50.824068 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-750dfda4-4128-45c2-90cb-0ff52f515aaa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:50.834789 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-750dfda4-4128-45c2-90cb-0ff52f515aaa tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1266 microversion: 2.1 time: 0.192006 Jun 14 19:50:50.835363 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 489/960] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:50 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:50:51.852225 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-6a9141d8-e6e8-4078-881a-43e5bd4f6a3e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:51.852952 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-6a9141d8-e6e8-4078-881a-43e5bd4f6a3e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:51.860203 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6a9141d8-e6e8-4078-881a-43e5bd4f6a3e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:51.860868 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6a9141d8-e6e8-4078-881a-43e5bd4f6a3e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:51.861666 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6a9141d8-e6e8-4078-881a-43e5bd4f6a3e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:51.862103 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-6a9141d8-e6e8-4078-881a-43e5bd4f6a3e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:52.003501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-6a9141d8-e6e8-4078-881a-43e5bd4f6a3e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:52.011125 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-6a9141d8-e6e8-4078-881a-43e5bd4f6a3e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1266 microversion: 2.1 time: 0.163209 Jun 14 19:50:52.011676 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 472/961] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:51 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:53.028456 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f388c06c-ba93-497c-859b-d881b9fa7bcb tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:53.029063 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f388c06c-ba93-497c-859b-d881b9fa7bcb tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:53.035491 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f388c06c-ba93-497c-859b-d881b9fa7bcb tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:53.035939 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f388c06c-ba93-497c-859b-d881b9fa7bcb tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:53.036697 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f388c06c-ba93-497c-859b-d881b9fa7bcb tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:53.037130 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f388c06c-ba93-497c-859b-d881b9fa7bcb tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:53.177790 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-f388c06c-ba93-497c-859b-d881b9fa7bcb tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:53.186180 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f388c06c-ba93-497c-859b-d881b9fa7bcb tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1266 microversion: 2.1 time: 0.162154 Jun 14 19:50:53.186748 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 490/962] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:53 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:53.858943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-18066c30-9831-4f77-8f32-737a9dbf2afa req-b24069e6-e736-4a10-b76e-5b8a25540f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbde7130-9d05-4c60-bd6d-4b246459c4bc", "name": "network-vif-plugged", "status": "completed", "tag": "654d7ce2-229b-4415-aa73-ed1f8ea3e80f"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:50:53.867438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-18066c30-9831-4f77-8f32-737a9dbf2afa req-b24069e6-e736-4a10-b76e-5b8a25540f02 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:53.867921 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-18066c30-9831-4f77-8f32-737a9dbf2afa req-b24069e6-e736-4a10-b76e-5b8a25540f02 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:53.880725 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-18066c30-9831-4f77-8f32-737a9dbf2afa req-b24069e6-e736-4a10-b76e-5b8a25540f02 service nova] Creating event network-vif-plugged:654d7ce2-229b-4415-aa73-ed1f8ea3e80f for instance cbde7130-9d05-4c60-bd6d-4b246459c4bc on hv-cinder-84580 Jun 14 19:50:53.885694 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-18066c30-9831-4f77-8f32-737a9dbf2afa req-b24069e6-e736-4a10-b76e-5b8a25540f02 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030969 Jun 14 19:50:53.886347 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 473/963] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:50:54.203476 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f1da8177-0343-47e1-bd59-36db97a0b7e3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:54.204130 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f1da8177-0343-47e1-bd59-36db97a0b7e3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:54.210812 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1da8177-0343-47e1-bd59-36db97a0b7e3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:54.211264 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1da8177-0343-47e1-bd59-36db97a0b7e3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:54.212031 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1da8177-0343-47e1-bd59-36db97a0b7e3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:54.212463 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f1da8177-0343-47e1-bd59-36db97a0b7e3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:54.347467 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-f1da8177-0343-47e1-bd59-36db97a0b7e3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:54.354867 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f1da8177-0343-47e1-bd59-36db97a0b7e3 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1266 microversion: 2.1 time: 0.156141 Jun 14 19:50:54.355497 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 491/964] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:54 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:55.373753 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-63993b72-7a8d-4703-ba8d-0edaac4edccf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:55.374441 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-63993b72-7a8d-4703-ba8d-0edaac4edccf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:55.381015 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-63993b72-7a8d-4703-ba8d-0edaac4edccf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:55.381494 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-63993b72-7a8d-4703-ba8d-0edaac4edccf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:55.382250 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-63993b72-7a8d-4703-ba8d-0edaac4edccf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:55.382678 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-63993b72-7a8d-4703-ba8d-0edaac4edccf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:55.514894 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-63993b72-7a8d-4703-ba8d-0edaac4edccf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:55.522515 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-63993b72-7a8d-4703-ba8d-0edaac4edccf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1266 microversion: 2.1 time: 0.154072 Jun 14 19:50:55.523100 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 474/965] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:55 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:56.595121 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c1684b44-3a1f-44be-85b9-3c9b5fc0f9bf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:56.595749 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c1684b44-3a1f-44be-85b9-3c9b5fc0f9bf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:56.602336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c1684b44-3a1f-44be-85b9-3c9b5fc0f9bf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:56.602785 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c1684b44-3a1f-44be-85b9-3c9b5fc0f9bf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:56.603541 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c1684b44-3a1f-44be-85b9-3c9b5fc0f9bf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:56.603973 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c1684b44-3a1f-44be-85b9-3c9b5fc0f9bf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:56.735650 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c1684b44-3a1f-44be-85b9-3c9b5fc0f9bf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:56.743078 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c1684b44-3a1f-44be-85b9-3c9b5fc0f9bf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1266 microversion: 2.1 time: 0.151807 Jun 14 19:50:56.743644 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 492/966] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:56 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:57.759831 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-ce96deab-970d-4c99-93cf-5e2ca4ef1f91 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:57.760449 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-ce96deab-970d-4c99-93cf-5e2ca4ef1f91 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:57.767842 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ce96deab-970d-4c99-93cf-5e2ca4ef1f91 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:57.768241 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ce96deab-970d-4c99-93cf-5e2ca4ef1f91 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:57.769004 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ce96deab-970d-4c99-93cf-5e2ca4ef1f91 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:57.769465 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-ce96deab-970d-4c99-93cf-5e2ca4ef1f91 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:57.903001 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-ce96deab-970d-4c99-93cf-5e2ca4ef1f91 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:57.910626 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-ce96deab-970d-4c99-93cf-5e2ca4ef1f91 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1452 microversion: 2.1 time: 0.154635 Jun 14 19:50:57.911185 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 475/967] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:57 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:57.927550 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c513de8c-490b-4ce6-812c-039e7faa295e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:50:57.928159 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c513de8c-490b-4ce6-812c-039e7faa295e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:50:57.934954 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c513de8c-490b-4ce6-812c-039e7faa295e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:57.935638 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c513de8c-490b-4ce6-812c-039e7faa295e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:57.936396 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c513de8c-490b-4ce6-812c-039e7faa295e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:57.936827 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c513de8c-490b-4ce6-812c-039e7faa295e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:58.070304 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c513de8c-490b-4ce6-812c-039e7faa295e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:50:58.078425 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c513de8c-490b-4ce6-812c-039e7faa295e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1452 microversion: 2.1 time: 0.154698 Jun 14 19:50:58.078986 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 493/968] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:50:57 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:50:59.753878 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-91786519-4424-42e2-8598-c5adfe4259e2 req-ef7f5e7c-6a70-4b41-84f3-81121944216d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbde7130-9d05-4c60-bd6d-4b246459c4bc", "tag": "654d7ce2-229b-4415-aa73-ed1f8ea3e80f"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:50:59.762876 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-91786519-4424-42e2-8598-c5adfe4259e2 req-ef7f5e7c-6a70-4b41-84f3-81121944216d service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:50:59.763316 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-91786519-4424-42e2-8598-c5adfe4259e2 req-ef7f5e7c-6a70-4b41-84f3-81121944216d service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:50:59.774339 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-91786519-4424-42e2-8598-c5adfe4259e2 req-ef7f5e7c-6a70-4b41-84f3-81121944216d service nova] Creating event network-changed:654d7ce2-229b-4415-aa73-ed1f8ea3e80f for instance cbde7130-9d05-4c60-bd6d-4b246459c4bc on hv-cinder-84580 Jun 14 19:50:59.779671 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-91786519-4424-42e2-8598-c5adfe4259e2 req-ef7f5e7c-6a70-4b41-84f3-81121944216d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029201 Jun 14 19:50:59.780259 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 476/969] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:51:14.155711 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-747beb9a-16dd-4ca3-b30d-ff6235e7633c tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:51:14.156641 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-747beb9a-16dd-4ca3-b30d-ff6235e7633c tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:14.159688 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=19 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:51:14.160598 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=59 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:51:14.169475 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-747beb9a-16dd-4ca3-b30d-ff6235e7633c tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:14.170745 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-747beb9a-16dd-4ca3-b30d-ff6235e7633c tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:14.171796 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-747beb9a-16dd-4ca3-b30d-ff6235e7633c tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:14.172301 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-747beb9a-16dd-4ca3-b30d-ff6235e7633c tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:14.246619 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-747beb9a-16dd-4ca3-b30d-ff6235e7633c tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "POST /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/action" status: 202 len: 0 microversion: 2.1 time: 0.095761 Jun 14 19:51:14.247236 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 494/970] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 14 19:51:14 2022] POST /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:51:14.256779 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a805451e-e6c5-4881-be22-d187762f6b84 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:14.257517 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a805451e-e6c5-4881-be22-d187762f6b84 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:14.259653 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=25 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:51:14.260345 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=55 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:51:14.267258 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a805451e-e6c5-4881-be22-d187762f6b84 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:14.267731 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a805451e-e6c5-4881-be22-d187762f6b84 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:14.268528 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a805451e-e6c5-4881-be22-d187762f6b84 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:14.269011 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a805451e-e6c5-4881-be22-d187762f6b84 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:14.423698 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a805451e-e6c5-4881-be22-d187762f6b84 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:14.431673 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a805451e-e6c5-4881-be22-d187762f6b84 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1751 microversion: 2.1 time: 0.179988 Jun 14 19:51:14.432232 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 477/971] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:14 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:51:15.450040 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-4df75286-1d51-48e8-bf55-8c187add3005 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:15.450940 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-4df75286-1d51-48e8-bf55-8c187add3005 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:15.458429 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4df75286-1d51-48e8-bf55-8c187add3005 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:15.458877 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4df75286-1d51-48e8-bf55-8c187add3005 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:15.459641 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4df75286-1d51-48e8-bf55-8c187add3005 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:15.460072 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-4df75286-1d51-48e8-bf55-8c187add3005 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:15.610227 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-4df75286-1d51-48e8-bf55-8c187add3005 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:15.618763 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-4df75286-1d51-48e8-bf55-8c187add3005 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1756 microversion: 2.1 time: 0.172989 Jun 14 19:51:15.619389 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 495/972] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:15 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:51:16.636347 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-08bd56f6-718a-468e-8a9b-ed9847036609 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:16.636959 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-08bd56f6-718a-468e-8a9b-ed9847036609 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:16.644592 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-08bd56f6-718a-468e-8a9b-ed9847036609 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:16.645047 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-08bd56f6-718a-468e-8a9b-ed9847036609 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:16.645909 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-08bd56f6-718a-468e-8a9b-ed9847036609 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:16.646340 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-08bd56f6-718a-468e-8a9b-ed9847036609 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:16.786567 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-08bd56f6-718a-468e-8a9b-ed9847036609 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:16.794489 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-08bd56f6-718a-468e-8a9b-ed9847036609 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1756 microversion: 2.1 time: 0.161972 Jun 14 19:51:16.795579 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 478/973] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:16 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:51:17.813994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c1410bc6-a0b6-4db9-8270-9c3b830bc733 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:17.815133 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c1410bc6-a0b6-4db9-8270-9c3b830bc733 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:17.821967 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c1410bc6-a0b6-4db9-8270-9c3b830bc733 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:17.822413 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c1410bc6-a0b6-4db9-8270-9c3b830bc733 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:17.823180 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c1410bc6-a0b6-4db9-8270-9c3b830bc733 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:17.823607 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c1410bc6-a0b6-4db9-8270-9c3b830bc733 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:17.963551 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c1410bc6-a0b6-4db9-8270-9c3b830bc733 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:17.971933 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c1410bc6-a0b6-4db9-8270-9c3b830bc733 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1756 microversion: 2.1 time: 0.163792 Jun 14 19:51:17.972485 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 496/974] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:17 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:51:18.989278 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c5d65ef9-1e28-4b86-88cc-64aec84bb92b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:18.989836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c5d65ef9-1e28-4b86-88cc-64aec84bb92b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:18.996187 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c5d65ef9-1e28-4b86-88cc-64aec84bb92b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:18.996627 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c5d65ef9-1e28-4b86-88cc-64aec84bb92b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:18.997397 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c5d65ef9-1e28-4b86-88cc-64aec84bb92b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:18.998292 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c5d65ef9-1e28-4b86-88cc-64aec84bb92b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:19.143739 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c5d65ef9-1e28-4b86-88cc-64aec84bb92b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:19.151620 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c5d65ef9-1e28-4b86-88cc-64aec84bb92b tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1756 microversion: 2.1 time: 0.166296 Jun 14 19:51:19.152174 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 479/975] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:18 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:51:20.169153 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-6a13bb68-3e70-4b8b-9f57-e8f38305ff05 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:20.170982 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-6a13bb68-3e70-4b8b-9f57-e8f38305ff05 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:20.177460 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6a13bb68-3e70-4b8b-9f57-e8f38305ff05 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:20.177983 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6a13bb68-3e70-4b8b-9f57-e8f38305ff05 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:20.178733 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6a13bb68-3e70-4b8b-9f57-e8f38305ff05 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:20.179159 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-6a13bb68-3e70-4b8b-9f57-e8f38305ff05 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:20.318180 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-6a13bb68-3e70-4b8b-9f57-e8f38305ff05 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:20.326092 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-6a13bb68-3e70-4b8b-9f57-e8f38305ff05 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1756 microversion: 2.1 time: 0.160717 Jun 14 19:51:20.326687 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 497/976] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:20 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:51:21.343140 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-428de9b3-5283-45df-8dbb-2c94222dad04 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:21.343751 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-428de9b3-5283-45df-8dbb-2c94222dad04 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:21.350239 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-428de9b3-5283-45df-8dbb-2c94222dad04 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:21.350689 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-428de9b3-5283-45df-8dbb-2c94222dad04 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:21.351446 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-428de9b3-5283-45df-8dbb-2c94222dad04 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:21.351878 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-428de9b3-5283-45df-8dbb-2c94222dad04 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:21.491778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-428de9b3-5283-45df-8dbb-2c94222dad04 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:21.500274 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-428de9b3-5283-45df-8dbb-2c94222dad04 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1756 microversion: 2.1 time: 0.161021 Jun 14 19:51:21.500833 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 480/977] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:21 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:51:22.518190 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-ae0fdf2b-912a-4369-bdcf-61cc07e6431a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:22.518794 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-ae0fdf2b-912a-4369-bdcf-61cc07e6431a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:22.525113 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ae0fdf2b-912a-4369-bdcf-61cc07e6431a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:22.525588 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ae0fdf2b-912a-4369-bdcf-61cc07e6431a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:22.526338 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ae0fdf2b-912a-4369-bdcf-61cc07e6431a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:22.526766 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ae0fdf2b-912a-4369-bdcf-61cc07e6431a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:22.671199 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ae0fdf2b-912a-4369-bdcf-61cc07e6431a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:22.679095 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-ae0fdf2b-912a-4369-bdcf-61cc07e6431a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1756 microversion: 2.1 time: 0.165024 Jun 14 19:51:22.679652 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 498/978] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:22 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:51:23.700178 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-683072b8-10b7-46a9-904c-7ec4068007c0 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:23.700810 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-683072b8-10b7-46a9-904c-7ec4068007c0 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:23.707416 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-683072b8-10b7-46a9-904c-7ec4068007c0 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:23.707861 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-683072b8-10b7-46a9-904c-7ec4068007c0 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:23.708620 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-683072b8-10b7-46a9-904c-7ec4068007c0 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:23.709053 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-683072b8-10b7-46a9-904c-7ec4068007c0 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:23.850963 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-683072b8-10b7-46a9-904c-7ec4068007c0 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:23.859294 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-683072b8-10b7-46a9-904c-7ec4068007c0 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1756 microversion: 2.1 time: 0.162457 Jun 14 19:51:23.860002 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 481/979] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:23 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:51:24.877009 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-0b373a47-0b10-40b1-ad80-8c3e5dab3198 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:24.877573 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-0b373a47-0b10-40b1-ad80-8c3e5dab3198 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:24.884057 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0b373a47-0b10-40b1-ad80-8c3e5dab3198 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:24.884501 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0b373a47-0b10-40b1-ad80-8c3e5dab3198 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:24.885250 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0b373a47-0b10-40b1-ad80-8c3e5dab3198 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:24.885714 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-0b373a47-0b10-40b1-ad80-8c3e5dab3198 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:25.025158 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-0b373a47-0b10-40b1-ad80-8c3e5dab3198 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:25.034112 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-0b373a47-0b10-40b1-ad80-8c3e5dab3198 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1756 microversion: 2.1 time: 0.160911 Jun 14 19:51:25.034679 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 499/980] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:24 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:51:26.051819 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-9ed19631-ddea-4b94-999b-6f7add37eafa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:26.052466 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-9ed19631-ddea-4b94-999b-6f7add37eafa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:26.059229 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9ed19631-ddea-4b94-999b-6f7add37eafa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:26.059676 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9ed19631-ddea-4b94-999b-6f7add37eafa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:26.060468 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9ed19631-ddea-4b94-999b-6f7add37eafa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:26.060902 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-9ed19631-ddea-4b94-999b-6f7add37eafa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:26.204415 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-9ed19631-ddea-4b94-999b-6f7add37eafa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:26.212523 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-9ed19631-ddea-4b94-999b-6f7add37eafa tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1756 microversion: 2.1 time: 0.165384 Jun 14 19:51:26.213082 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 482/981] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:26 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:51:27.229616 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-95dfed60-aa00-4a09-ad23-397c7080e940 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:27.230207 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-95dfed60-aa00-4a09-ad23-397c7080e940 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:27.237125 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-95dfed60-aa00-4a09-ad23-397c7080e940 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:27.237609 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-95dfed60-aa00-4a09-ad23-397c7080e940 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:27.238369 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-95dfed60-aa00-4a09-ad23-397c7080e940 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:27.238803 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-95dfed60-aa00-4a09-ad23-397c7080e940 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:27.384248 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-95dfed60-aa00-4a09-ad23-397c7080e940 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:27.392519 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-95dfed60-aa00-4a09-ad23-397c7080e940 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1756 microversion: 2.1 time: 0.166698 Jun 14 19:51:27.393088 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 500/982] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:27 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:51:28.410318 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-f6756e30-a430-4ca9-b8d4-0dece443fa11 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:28.410924 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-f6756e30-a430-4ca9-b8d4-0dece443fa11 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:28.417728 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f6756e30-a430-4ca9-b8d4-0dece443fa11 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:28.418118 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f6756e30-a430-4ca9-b8d4-0dece443fa11 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:28.418870 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f6756e30-a430-4ca9-b8d4-0dece443fa11 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:28.419294 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-f6756e30-a430-4ca9-b8d4-0dece443fa11 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:28.558317 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-f6756e30-a430-4ca9-b8d4-0dece443fa11 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:28.567101 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-f6756e30-a430-4ca9-b8d4-0dece443fa11 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1756 microversion: 2.1 time: 0.161124 Jun 14 19:51:28.567660 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 483/983] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:28 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:51:29.584614 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b4910617-4dea-48a2-b133-9e59c83ffacc tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:29.585247 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b4910617-4dea-48a2-b133-9e59c83ffacc tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:29.591633 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b4910617-4dea-48a2-b133-9e59c83ffacc tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:29.592080 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b4910617-4dea-48a2-b133-9e59c83ffacc tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:29.592859 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b4910617-4dea-48a2-b133-9e59c83ffacc tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:29.593288 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b4910617-4dea-48a2-b133-9e59c83ffacc tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:29.735703 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b4910617-4dea-48a2-b133-9e59c83ffacc tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:29.744710 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b4910617-4dea-48a2-b133-9e59c83ffacc tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1756 microversion: 2.1 time: 0.164553 Jun 14 19:51:29.745270 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 501/984] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:29 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:51:30.762836 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-84bf8220-e60f-448f-aea7-c54d28eb7d76 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:30.763457 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-84bf8220-e60f-448f-aea7-c54d28eb7d76 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:30.770543 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-84bf8220-e60f-448f-aea7-c54d28eb7d76 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:30.770992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-84bf8220-e60f-448f-aea7-c54d28eb7d76 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:30.771760 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-84bf8220-e60f-448f-aea7-c54d28eb7d76 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:30.772194 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-84bf8220-e60f-448f-aea7-c54d28eb7d76 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:31.167020 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-84bf8220-e60f-448f-aea7-c54d28eb7d76 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:31.175090 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-84bf8220-e60f-448f-aea7-c54d28eb7d76 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1756 microversion: 2.1 time: 0.416139 Jun 14 19:51:31.175655 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 484/985] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:30 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1756 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:51:32.192869 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-88f8abca-d779-43c8-825e-01062a82ce2f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:32.193575 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-88f8abca-d779-43c8-825e-01062a82ce2f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:32.200733 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-88f8abca-d779-43c8-825e-01062a82ce2f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:32.201188 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-88f8abca-d779-43c8-825e-01062a82ce2f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:32.202001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-88f8abca-d779-43c8-825e-01062a82ce2f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:32.202440 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-88f8abca-d779-43c8-825e-01062a82ce2f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:32.352397 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-88f8abca-d779-43c8-825e-01062a82ce2f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:32.360286 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-88f8abca-d779-43c8-825e-01062a82ce2f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1756 microversion: 2.1 time: 0.172062 Jun 14 19:51:32.360851 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 502/986] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:32 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:51:33.378977 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-55a2fd3a-942e-487a-803c-82c41d7eebac tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:51:33.379593 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-55a2fd3a-942e-487a-803c-82c41d7eebac tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:51:33.386091 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-55a2fd3a-942e-487a-803c-82c41d7eebac tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:33.386539 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-55a2fd3a-942e-487a-803c-82c41d7eebac tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:33.387302 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-55a2fd3a-942e-487a-803c-82c41d7eebac tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:51:33.387741 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-55a2fd3a-942e-487a-803c-82c41d7eebac tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:51:33.531344 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-55a2fd3a-942e-487a-803c-82c41d7eebac tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:51:33.539771 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-55a2fd3a-942e-487a-803c-82c41d7eebac tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1759 microversion: 2.1 time: 0.165250 Jun 14 19:51:33.540342 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 485/987] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:51:33 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:52:06.367672 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3facfadf-49fe-497f-b010-a76f1c520c57 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-126110270"}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:52:06.368258 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3facfadf-49fe-497f-b010-a76f1c520c57 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:52:06.370468 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=18 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:52:06.371135 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:52:06.376941 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3facfadf-49fe-497f-b010-a76f1c520c57 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:06.377399 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3facfadf-49fe-497f-b010-a76f1c520c57 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:06.378166 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3facfadf-49fe-497f-b010-a76f1c520c57 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:06.378623 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3facfadf-49fe-497f-b010-a76f1c520c57 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:06.662840 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.network.security_group_api [None req-3facfadf-49fe-497f-b010-a76f1c520c57 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Removing security group f1e053c2-5026-428f-88fa-439d68ad5083 from port 1f4d48ec-b2f5-4b1d-a657-de6c50297a2b Jun 14 19:52:06.999212 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3facfadf-49fe-497f-b010-a76f1c520c57 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "POST /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/action" status: 202 len: 0 microversion: 2.1 time: 0.635729 Jun 14 19:52:07.003753 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 503/988] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 14 19:52:06 2022] POST /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/action => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:52:07.010109 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-13114a93-5e3a-426f-a4fb-2a24e446b1b4 req-28e15dc3-cc56-4e9f-8434-6b91f918729a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e138df4-7be3-4669-9687-d1458a243dc0", "tag": "1f4d48ec-b2f5-4b1d-a657-de6c50297a2b"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:52:07.017448 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=18 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:52:07.019117 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=54 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:52:07.022349 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-13114a93-5e3a-426f-a4fb-2a24e446b1b4 req-28e15dc3-cc56-4e9f-8434-6b91f918729a service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:07.023132 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-13114a93-5e3a-426f-a4fb-2a24e446b1b4 req-28e15dc3-cc56-4e9f-8434-6b91f918729a service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:07.036787 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-13114a93-5e3a-426f-a4fb-2a24e446b1b4 req-28e15dc3-cc56-4e9f-8434-6b91f918729a service nova] Creating event network-changed:1f4d48ec-b2f5-4b1d-a657-de6c50297a2b for instance 8e138df4-7be3-4669-9687-d1458a243dc0 on hv-cinder-84580 Jun 14 19:52:07.048762 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-13114a93-5e3a-426f-a4fb-2a24e446b1b4 req-28e15dc3-cc56-4e9f-8434-6b91f918729a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042164 Jun 14 19:52:07.051534 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 486/989] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:52:08.336395 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1f2e652b-b3c3-4f39-8aab-da68ee991eb8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:52:08.336929 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1f2e652b-b3c3-4f39-8aab-da68ee991eb8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:52:08.342920 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1f2e652b-b3c3-4f39-8aab-da68ee991eb8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:08.343374 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1f2e652b-b3c3-4f39-8aab-da68ee991eb8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:08.344145 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1f2e652b-b3c3-4f39-8aab-da68ee991eb8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:08.344586 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1f2e652b-b3c3-4f39-8aab-da68ee991eb8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:08.427411 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.objects.instance [None req-1f2e652b-b3c3-4f39-8aab-da68ee991eb8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lazy-loading 'services' on Instance uuid 8e138df4-7be3-4669-9687-d1458a243dc0 {{(pid=124068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:52:08.501662 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1f2e652b-b3c3-4f39-8aab-da68ee991eb8 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/os-volume_attachments/12855736-e14c-4a9d-99c9-0c304f48224e" status: 202 len: 0 microversion: 2.1 time: 0.169420 Jun 14 19:52:08.502285 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 504/990] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 14 19:52:08 2022] DELETE /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/os-volume_attachments/12855736-e14c-4a9d-99c9-0c304f48224e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:52:08.512179 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4fc1e76a-4a16-4dde-a001-507d0c2c7455 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:52:08.513199 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4fc1e76a-4a16-4dde-a001-507d0c2c7455 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:52:08.520860 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4fc1e76a-4a16-4dde-a001-507d0c2c7455 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:08.521660 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4fc1e76a-4a16-4dde-a001-507d0c2c7455 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:08.522632 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4fc1e76a-4a16-4dde-a001-507d0c2c7455 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:08.523078 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-4fc1e76a-4a16-4dde-a001-507d0c2c7455 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:08.560333 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4fc1e76a-4a16-4dde-a001-507d0c2c7455 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053235 Jun 14 19:52:08.564598 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 487/991] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:52:08 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:52:09.064840 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-b2b1e5fe-9705-42c1-8abd-c7fad019fba5 req-95a9e1e7-8246-4ea9-8fce-a502dbe411d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e138df4-7be3-4669-9687-d1458a243dc0", "tag": "1f4d48ec-b2f5-4b1d-a657-de6c50297a2b"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:52:09.074905 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-b2b1e5fe-9705-42c1-8abd-c7fad019fba5 req-95a9e1e7-8246-4ea9-8fce-a502dbe411d7 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:09.075349 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-b2b1e5fe-9705-42c1-8abd-c7fad019fba5 req-95a9e1e7-8246-4ea9-8fce-a502dbe411d7 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:09.088543 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-b2b1e5fe-9705-42c1-8abd-c7fad019fba5 req-95a9e1e7-8246-4ea9-8fce-a502dbe411d7 service nova] Creating event network-changed:1f4d48ec-b2f5-4b1d-a657-de6c50297a2b for instance 8e138df4-7be3-4669-9687-d1458a243dc0 on hv-cinder-84580 Jun 14 19:52:09.093427 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-b2b1e5fe-9705-42c1-8abd-c7fad019fba5 req-95a9e1e7-8246-4ea9-8fce-a502dbe411d7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032659 Jun 14 19:52:09.094019 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 505/992] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:52:09.572347 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-68bc1def-6f8e-4051-b75d-85ebfa346d38 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:52:09.574249 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-68bc1def-6f8e-4051-b75d-85ebfa346d38 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:52:09.581863 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-68bc1def-6f8e-4051-b75d-85ebfa346d38 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:09.582311 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-68bc1def-6f8e-4051-b75d-85ebfa346d38 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:09.583086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-68bc1def-6f8e-4051-b75d-85ebfa346d38 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:09.583516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-68bc1def-6f8e-4051-b75d-85ebfa346d38 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:09.614149 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-68bc1def-6f8e-4051-b75d-85ebfa346d38 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046043 Jun 14 19:52:09.614935 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 488/993] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 14 19:52:09 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 19:52:09.626892 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-dc411db0-e211-43f8-b085-522e23c2ad5a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:52:09.627504 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-dc411db0-e211-43f8-b085-522e23c2ad5a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:52:09.633800 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dc411db0-e211-43f8-b085-522e23c2ad5a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:09.634244 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dc411db0-e211-43f8-b085-522e23c2ad5a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:09.634992 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dc411db0-e211-43f8-b085-522e23c2ad5a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:09.635417 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dc411db0-e211-43f8-b085-522e23c2ad5a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:09.710761 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-dc411db0-e211-43f8-b085-522e23c2ad5a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] HTTP exception thrown: Instance 8e138df4-7be3-4669-9687-d1458a243dc0 is not attached to volume 12855736-e14c-4a9d-99c9-0c304f48224e Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-dc411db0-e211-43f8-b085-522e23c2ad5a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Request method failure captured: Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: DELETE /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/os-volume_attachments/12855736-e14c-4a9d-99c9-0c304f48224e HTTP/1.1 Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOZa69V8S2PamWBf-Fsx0J3p11cZwTkI-9S1ax39_-TzVF4n4fQ0OfoVW6mddnrZ-TpmwV9F1jpjAaOELudqOD_59e7A2921IwP3qqWMP4X9dz-f3YvRSQn1YTu51Kw2npJ9zysJ-T5TEn1gI7hkBiG6ZXCNfQ9SG81wvXq40hkEpH8 Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: a9af0b38d9fa4db0bfd12c0d1b51b12f Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-TestMinimumBasicScenario-1720138364 Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:52:09.713075 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:52:09.714782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9af0b38d9fa4db0bfd12c0d1b51b12f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a9af0b38d9fa4db0bfd12c0d1b51b12f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a9af0b38d9fa4db0bfd12c0d1b51b12f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9af0b38d9fa4db0bfd12c0d1b51b12f"}]}] Jun 14 19:52:09.714782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-TestMinimumBasicScenario-1720138364 Jun 14 19:52:09.714782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: a9af0b38d9fa4db0bfd12c0d1b51b12f Jun 14 19:52:09.714782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1720138364 Jun 14 19:52:09.714782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-TestMinimumBasicScenario-1720138364-project Jun 14 19:52:09.714782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:52:09.714782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:52:09.714782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: f2d3d11f92e3400c9ec8f35677a44198 Jun 14 19:52:09.714782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-TestMinimumBasicScenario-1720138364-project Jun 14 19:52:09.714782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:52:09.714782 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance 8e138df4-7be3-4669-9687-d1458a243dc0 is not attached to volume 12855736-e14c-4a9d-99c9-0c304f48224e Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'server_id': '8e138df4-7be3-4669-9687-d1458a243dc0', 'id': '12855736-e14c-4a9d-99c9-0c304f48224e'} Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 12855736-e14c-4a9d-99c9-0c304f48224e. Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:52:09.715694 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:52:09.717241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:52:09.717241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 14 19:52:09.717241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 14 19:52:09.717241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e138df4-7be3-4669-9687-d1458a243dc0 is not attached to volume 12855736-e14c-4a9d-99c9-0c304f48224e Jun 14 19:52:09.717241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:52:09.717241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:52:09.717241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:52:09.717241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:52:09.717241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:52:09.717241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:52:09.717241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:52:09.717241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:52:09.717241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e138df4-7be3-4669-9687-d1458a243dc0 is not attached to volume 12855736-e14c-4a9d-99c9-0c304f48224e Jun 14 19:52:09.717241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:52:09.717241 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-dc411db0-e211-43f8-b085-522e23c2ad5a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Returning 404 to user: Instance 8e138df4-7be3-4669-9687-d1458a243dc0 is not attached to volume 12855736-e14c-4a9d-99c9-0c304f48224e {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:52:09.718417 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-dc411db0-e211-43f8-b085-522e23c2ad5a tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/os-volume_attachments/12855736-e14c-4a9d-99c9-0c304f48224e" status: 404 len: 154 microversion: 2.1 time: 0.093227 Jun 14 19:52:09.718417 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 506/994] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 14 19:52:09 2022] DELETE /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0/os-volume_attachments/12855736-e14c-4a9d-99c9-0c304f48224e => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:52:10.847781 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a44d6f5d-02b2-4bbd-ad23-3daf8a100368 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:52:10.848267 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a44d6f5d-02b2-4bbd-ad23-3daf8a100368 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:52:10.854701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a44d6f5d-02b2-4bbd-ad23-3daf8a100368 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:10.855150 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a44d6f5d-02b2-4bbd-ad23-3daf8a100368 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:10.855910 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a44d6f5d-02b2-4bbd-ad23-3daf8a100368 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:10.856344 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a44d6f5d-02b2-4bbd-ad23-3daf8a100368 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:10.881680 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a44d6f5d-02b2-4bbd-ad23-3daf8a100368 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Going to try to terminate instance {{(pid=124069) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:52:10.954883 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a44d6f5d-02b2-4bbd-ad23-3daf8a100368 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 204 len: 0 microversion: 2.1 time: 0.110834 Jun 14 19:52:10.955514 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 489/995] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:52:10 2022] DELETE /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:52:10.963770 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-7c6ca346-d901-4493-873b-6f78bba51a7f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:52:10.964389 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-7c6ca346-d901-4493-873b-6f78bba51a7f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:52:10.970748 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7c6ca346-d901-4493-873b-6f78bba51a7f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:10.971264 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7c6ca346-d901-4493-873b-6f78bba51a7f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:10.972060 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7c6ca346-d901-4493-873b-6f78bba51a7f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:10.972499 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7c6ca346-d901-4493-873b-6f78bba51a7f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:11.102111 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-7c6ca346-d901-4493-873b-6f78bba51a7f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:52:11.109418 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-7c6ca346-d901-4493-873b-6f78bba51a7f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1554 microversion: 2.1 time: 0.149463 Jun 14 19:52:11.109973 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 507/996] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:52:10 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:52:12.128598 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-5524d502-2261-48d0-a561-0e920eec8e1f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:52:12.129221 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-5524d502-2261-48d0-a561-0e920eec8e1f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:52:12.136489 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5524d502-2261-48d0-a561-0e920eec8e1f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:12.136931 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5524d502-2261-48d0-a561-0e920eec8e1f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:12.137735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5524d502-2261-48d0-a561-0e920eec8e1f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:12.138156 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-5524d502-2261-48d0-a561-0e920eec8e1f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:12.323546 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-5524d502-2261-48d0-a561-0e920eec8e1f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:52:12.331756 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-5524d502-2261-48d0-a561-0e920eec8e1f tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1554 microversion: 2.1 time: 0.207931 Jun 14 19:52:12.332324 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 490/997] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:52:12 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1554 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 19:52:12.957749 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 19:52:12.957952 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Tue Jun 14 19:52:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 19:52:13.099268 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-02c653db-67eb-4aaf-af26-4104ce27fe7c req-0812c7dd-ab63-4209-9ff4-81d6b8c0cc50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e138df4-7be3-4669-9687-d1458a243dc0", "name": "network-vif-deleted", "tag": "1f4d48ec-b2f5-4b1d-a657-de6c50297a2b"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:52:13.107776 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-02c653db-67eb-4aaf-af26-4104ce27fe7c req-0812c7dd-ab63-4209-9ff4-81d6b8c0cc50 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:13.108221 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-02c653db-67eb-4aaf-af26-4104ce27fe7c req-0812c7dd-ab63-4209-9ff4-81d6b8c0cc50 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:13.119539 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-02c653db-67eb-4aaf-af26-4104ce27fe7c req-0812c7dd-ab63-4209-9ff4-81d6b8c0cc50 service nova] Creating event network-vif-deleted:1f4d48ec-b2f5-4b1d-a657-de6c50297a2b for instance 8e138df4-7be3-4669-9687-d1458a243dc0 on hv-cinder-84580 Jun 14 19:52:13.124661 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-02c653db-67eb-4aaf-af26-4104ce27fe7c req-0812c7dd-ab63-4209-9ff4-81d6b8c0cc50 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030268 Jun 14 19:52:13.125257 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 508/998] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:52:13.348270 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-26887ec0-cb18-4b00-9944-635b851be068 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:52:13.348798 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-26887ec0-cb18-4b00-9944-635b851be068 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:52:13.355424 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-26887ec0-cb18-4b00-9944-635b851be068 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:13.355816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-26887ec0-cb18-4b00-9944-635b851be068 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:13.356610 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-26887ec0-cb18-4b00-9944-635b851be068 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:13.357040 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-26887ec0-cb18-4b00-9944-635b851be068 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:13.389666 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-26887ec0-cb18-4b00-9944-635b851be068 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:13.390118 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-26887ec0-cb18-4b00-9944-635b851be068 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:13.390584 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.objects.instance [None req-26887ec0-cb18-4b00-9944-635b851be068 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lazy-loading 'fault' on Instance uuid 8e138df4-7be3-4669-9687-d1458a243dc0 {{(pid=124069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:52:13.434614 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-26887ec0-cb18-4b00-9944-635b851be068 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d3d11f92e3400c9ec8f35677a44198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:52:13.443860 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-26887ec0-cb18-4b00-9944-635b851be068 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 200 len: 1349 microversion: 2.1 time: 0.099678 Jun 14 19:52:13.444632 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 491/999] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:52:13 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:52:14.462216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9bd214d7-0913-41c0-9012-a35e69aa23f5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:52:14.462826 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9bd214d7-0913-41c0-9012-a35e69aa23f5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] [instance: 8e138df4-7be3-4669-9687-d1458a243dc0] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:52:14.469027 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9bd214d7-0913-41c0-9012-a35e69aa23f5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:14.469513 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9bd214d7-0913-41c0-9012-a35e69aa23f5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:14.470267 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9bd214d7-0913-41c0-9012-a35e69aa23f5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:52:14.470724 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9bd214d7-0913-41c0-9012-a35e69aa23f5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:52:14.483639 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-9bd214d7-0913-41c0-9012-a35e69aa23f5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] HTTP exception thrown: Instance 8e138df4-7be3-4669-9687-d1458a243dc0 could not be found. Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9bd214d7-0913-41c0-9012-a35e69aa23f5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Request method failure captured: Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 HTTP/1.1 Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOZa69V8S2PamWBf-Fsx0J3p11cZwTkI-9S1ax39_-TzVF4n4fQ0OfoVW6mddnrZ-TpmwV9F1jpjAaOELudqOD_59e7A2921IwP3qqWMP4X9dz-f3YvRSQn1YTu51Kw2npJ9zysJ-T5TEn1gI7hkBiG6ZXCNfQ9SG81wvXq40hkEpH8 Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: a9af0b38d9fa4db0bfd12c0d1b51b12f Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-TestMinimumBasicScenario-1720138364 Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:52:14.485216 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:52:14.487355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9af0b38d9fa4db0bfd12c0d1b51b12f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a9af0b38d9fa4db0bfd12c0d1b51b12f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a9af0b38d9fa4db0bfd12c0d1b51b12f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a9af0b38d9fa4db0bfd12c0d1b51b12f"}]}] Jun 14 19:52:14.487355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-TestMinimumBasicScenario-1720138364 Jun 14 19:52:14.487355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: a9af0b38d9fa4db0bfd12c0d1b51b12f Jun 14 19:52:14.487355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1720138364 Jun 14 19:52:14.487355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-TestMinimumBasicScenario-1720138364-project Jun 14 19:52:14.487355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:52:14.487355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:52:14.487355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: f2d3d11f92e3400c9ec8f35677a44198 Jun 14 19:52:14.487355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-TestMinimumBasicScenario-1720138364-project Jun 14 19:52:14.487355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:52:14.487355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance 8e138df4-7be3-4669-9687-d1458a243dc0 could not be found. Jun 14 19:52:14.487355 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': '8e138df4-7be3-4669-9687-d1458a243dc0'} Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e138df4-7be3-4669-9687-d1458a243dc0 could not be found. Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:52:14.488524 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e138df4-7be3-4669-9687-d1458a243dc0 could not be found. Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e138df4-7be3-4669-9687-d1458a243dc0 could not be found. Jun 14 19:52:14.490151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:52:14.491733 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9bd214d7-0913-41c0-9012-a35e69aa23f5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Returning 404 to user: Instance 8e138df4-7be3-4669-9687-d1458a243dc0 could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:52:14.491733 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9bd214d7-0913-41c0-9012-a35e69aa23f5 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0" status: 404 len: 111 microversion: 2.1 time: 0.029310 Jun 14 19:52:14.491733 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 509/1000] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:52:14 2022] GET /compute/v2.1/servers/8e138df4-7be3-4669-9687-d1458a243dc0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:52:14.496002 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-bc3c005f-db65-48dc-88a2-e0c5b1480438 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] Calling method '.version_select at 0x7f144b53bc10>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:52:14.518983 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-bc3c005f-db65-48dc-88a2-e0c5b1480438 tempest-TestMinimumBasicScenario-1720138364 tempest-TestMinimumBasicScenario-1720138364-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1830863092" status: 202 len: 0 microversion: 2.1 time: 0.026377 Jun 14 19:52:14.519563 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 492/1001] 10.222.0.44 () {58 vars in 1271 bytes} [Tue Jun 14 19:52:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1830863092 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:52:16.954001 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 19:52:16.954546 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Tue Jun 14 19:52:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 19:53:11.928615 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f235da17-6405-4e95-ad18-9cf1de8712c0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:11.929294 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f235da17-6405-4e95-ad18-9cf1de8712c0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:11.931378 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=14 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:53:11.932009 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:53:11.938378 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f235da17-6405-4e95-ad18-9cf1de8712c0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:11.938821 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f235da17-6405-4e95-ad18-9cf1de8712c0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:11.939570 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f235da17-6405-4e95-ad18-9cf1de8712c0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:11.940000 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f235da17-6405-4e95-ad18-9cf1de8712c0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:11.963955 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f235da17-6405-4e95-ad18-9cf1de8712c0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Going to try to terminate instance {{(pid=124068) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:53:12.037262 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f235da17-6405-4e95-ad18-9cf1de8712c0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 204 len: 0 microversion: 2.1 time: 0.113156 Jun 14 19:53:12.037861 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 510/1002] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:53:11 2022] DELETE /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:53:12.046286 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-8060dba5-6b05-47fa-ad50-c5e3bfbd15f4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:12.046886 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-8060dba5-6b05-47fa-ad50-c5e3bfbd15f4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:12.048934 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:53:12.049588 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:53:12.056790 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8060dba5-6b05-47fa-ad50-c5e3bfbd15f4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:12.057237 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8060dba5-6b05-47fa-ad50-c5e3bfbd15f4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:12.058050 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8060dba5-6b05-47fa-ad50-c5e3bfbd15f4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:12.058483 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-8060dba5-6b05-47fa-ad50-c5e3bfbd15f4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:12.193778 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-8060dba5-6b05-47fa-ad50-c5e3bfbd15f4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:12.201161 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-8060dba5-6b05-47fa-ad50-c5e3bfbd15f4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1576 microversion: 2.1 time: 0.159130 Jun 14 19:53:12.201739 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 493/1003] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:12 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:13.219313 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-2e993a1f-bd07-4f7b-8845-42f716a1bcbf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:13.220028 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-2e993a1f-bd07-4f7b-8845-42f716a1bcbf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:13.226483 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2e993a1f-bd07-4f7b-8845-42f716a1bcbf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:13.226926 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2e993a1f-bd07-4f7b-8845-42f716a1bcbf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:13.227674 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2e993a1f-bd07-4f7b-8845-42f716a1bcbf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:13.228099 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-2e993a1f-bd07-4f7b-8845-42f716a1bcbf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:13.365207 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-2e993a1f-bd07-4f7b-8845-42f716a1bcbf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:13.372830 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-2e993a1f-bd07-4f7b-8845-42f716a1bcbf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1576 microversion: 2.1 time: 0.157733 Jun 14 19:53:13.373410 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 511/1004] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:13 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:14.389586 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-49fa45d8-936a-45a5-9d4c-ea89be5b0992 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:14.390193 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-49fa45d8-936a-45a5-9d4c-ea89be5b0992 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:14.397994 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-49fa45d8-936a-45a5-9d4c-ea89be5b0992 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:14.398438 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-49fa45d8-936a-45a5-9d4c-ea89be5b0992 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:14.399194 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-49fa45d8-936a-45a5-9d4c-ea89be5b0992 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:14.399621 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-49fa45d8-936a-45a5-9d4c-ea89be5b0992 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:14.461533 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-49fa45d8-936a-45a5-9d4c-ea89be5b0992 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:14.469081 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-49fa45d8-936a-45a5-9d4c-ea89be5b0992 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 200 len: 1508 microversion: 2.1 time: 0.083385 Jun 14 19:53:14.469675 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 494/1005] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:14 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 1508 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:14.646425 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-3e9fcda8-f7b6-4d69-adc4-42cf81b4bc5f req-e9a7f230-6741-40c8-86b5-aecb6e6edde1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbde7130-9d05-4c60-bd6d-4b246459c4bc", "name": "network-vif-deleted", "tag": "654d7ce2-229b-4415-aa73-ed1f8ea3e80f"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:53:14.654766 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-3e9fcda8-f7b6-4d69-adc4-42cf81b4bc5f req-e9a7f230-6741-40c8-86b5-aecb6e6edde1 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:14.655208 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-3e9fcda8-f7b6-4d69-adc4-42cf81b4bc5f req-e9a7f230-6741-40c8-86b5-aecb6e6edde1 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:14.667871 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-3e9fcda8-f7b6-4d69-adc4-42cf81b4bc5f req-e9a7f230-6741-40c8-86b5-aecb6e6edde1 service nova] Creating event network-vif-deleted:654d7ce2-229b-4415-aa73-ed1f8ea3e80f for instance cbde7130-9d05-4c60-bd6d-4b246459c4bc on hv-cinder-84580 Jun 14 19:53:14.672951 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-3e9fcda8-f7b6-4d69-adc4-42cf81b4bc5f req-e9a7f230-6741-40c8-86b5-aecb6e6edde1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168971 Jun 14 19:53:14.673833 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 512/1006] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:53:15.486378 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a7b3961c-7bc8-444b-8d95-3b5c8ad82321 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:15.486982 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a7b3961c-7bc8-444b-8d95-3b5c8ad82321 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:15.493847 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a7b3961c-7bc8-444b-8d95-3b5c8ad82321 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:15.494288 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a7b3961c-7bc8-444b-8d95-3b5c8ad82321 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:15.495055 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a7b3961c-7bc8-444b-8d95-3b5c8ad82321 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:15.495465 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a7b3961c-7bc8-444b-8d95-3b5c8ad82321 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:15.509204 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-a7b3961c-7bc8-444b-8d95-3b5c8ad82321 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] HTTP exception thrown: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a7b3961c-7bc8-444b-8d95-3b5c8ad82321 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Request method failure captured: Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc HTTP/1.1 Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOZyIoY1ZBAtkBIvI7FD0gopNgNRbbpxvrFK96SD1NjJ1KnM2ePv3vZ7CtGM2acCsLx9_pM7iNrSJoidRff-NbLFJB3WpoGX9aE4gZuXXpkV4z3_kux8xMylTX8lWD4Wpyo8MRcVuS5Ed1KYaoslvl-UraqH--H88Ldzylpfsr9PBz0 Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: b0b8f372dfc54511a3f8c77baaa4f39a Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-TestVolumeBootPattern-769827167 Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:53:15.510871 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:53:15.512389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b0b8f372dfc54511a3f8c77baaa4f39a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b0b8f372dfc54511a3f8c77baaa4f39a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b0b8f372dfc54511a3f8c77baaa4f39a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b0b8f372dfc54511a3f8c77baaa4f39a"}]}] Jun 14 19:53:15.512389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-TestVolumeBootPattern-769827167 Jun 14 19:53:15.512389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: b0b8f372dfc54511a3f8c77baaa4f39a Jun 14 19:53:15.512389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-TestVolumeBootPattern-769827167 Jun 14 19:53:15.512389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-TestVolumeBootPattern-769827167-project Jun 14 19:53:15.512389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:53:15.512389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:53:15.512389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 10f209080b9745d0a13f60ce5e1ca7df Jun 14 19:53:15.512389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-TestVolumeBootPattern-769827167-project Jun 14 19:53:15.512389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:53:15.512389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. Jun 14 19:53:15.512389 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': 'cbde7130-9d05-4c60-bd6d-4b246459c4bc'} Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:53:15.513253 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. Jun 14 19:53:15.514644 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:53:15.515862 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a7b3961c-7bc8-444b-8d95-3b5c8ad82321 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Returning 404 to user: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:53:15.515862 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a7b3961c-7bc8-444b-8d95-3b5c8ad82321 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 404 len: 111 microversion: 2.1 time: 0.029810 Jun 14 19:53:15.515862 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 495/1007] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:15 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:53:15.609047 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1075244612", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1706851958", "security_groups": [{"name": "tempest-secgroup-smoke-1919502732"}], "block_device_mapping_v2": [{"uuid": "fe140541-4414-4649-9dad-3101d9ac75cb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5f9bd32b-81b7-4de4-b011-9decc2484677"}]}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:53:15.727128 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.network.neutron [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] validate_networks() for [('5f9bd32b-81b7-4de4-b011-9decc2484677', None, None, None, None, None)] {{(pid=124068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:53:16.101832 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Flavor limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:53:16.102259 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Image limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:53:16.102732 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Flavor pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:53:16.103141 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Image pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:53:16.103560 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:53:16.112998 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:16.113491 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:16.114300 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:16.114741 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:16.131842 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Getting quotas for project b0b8f372dfc54511a3f8c77baaa4f39a. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:53:16.135923 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Getting quotas for user 10f209080b9745d0a13f60ce5e1ca7df and project b0b8f372dfc54511a3f8c77baaa4f39a. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:53:16.192546 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Going to run 1 instances... {{(pid=124068) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:53:16.194745 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe140541-4414-4649-9dad-3101d9ac75cb',volume_size=None,volume_type=None)] {{(pid=124068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:53:16.320056 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-7fabeed0-eaa5-4e5f-8716-2aaf991e773b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.715664 Jun 14 19:53:16.320691 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 513/1008] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:53:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:53:16.330636 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-4307a388-d816-4395-9c80-d202f6afb275 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:16.331299 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-4307a388-d816-4395-9c80-d202f6afb275 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:16.383516 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-4307a388-d816-4395-9c80-d202f6afb275 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:16.390170 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-4307a388-d816-4395-9c80-d202f6afb275 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1095 microversion: 2.1 time: 0.063356 Jun 14 19:53:16.390729 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 496/1009] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:16 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:17.407596 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e902f8e8-b227-4854-8c0d-ee71d8e5eabf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:17.408432 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-e902f8e8-b227-4854-8c0d-ee71d8e5eabf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:17.417086 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e902f8e8-b227-4854-8c0d-ee71d8e5eabf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:17.417571 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e902f8e8-b227-4854-8c0d-ee71d8e5eabf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:17.418495 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e902f8e8-b227-4854-8c0d-ee71d8e5eabf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:17.418939 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-e902f8e8-b227-4854-8c0d-ee71d8e5eabf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:17.498792 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-e902f8e8-b227-4854-8c0d-ee71d8e5eabf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:17.506308 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e902f8e8-b227-4854-8c0d-ee71d8e5eabf tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1211 microversion: 2.1 time: 0.103034 Jun 14 19:53:17.506872 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 514/1010] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:17 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:18.524134 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b26a82d6-c0d7-402a-9a87-619cdc21b6ad tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:18.526275 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b26a82d6-c0d7-402a-9a87-619cdc21b6ad tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:18.533795 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b26a82d6-c0d7-402a-9a87-619cdc21b6ad tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:18.535098 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b26a82d6-c0d7-402a-9a87-619cdc21b6ad tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:18.535923 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b26a82d6-c0d7-402a-9a87-619cdc21b6ad tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:18.536435 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b26a82d6-c0d7-402a-9a87-619cdc21b6ad tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:18.685128 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-b26a82d6-c0d7-402a-9a87-619cdc21b6ad tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:18.693988 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-3cc90f5e-8ecb-4b60-a035-7c73b8219dbb req-4a8aa27b-7a26-4d69-8b4b-8706a5906172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf1d80b-9c9d-4f0f-9d08-53d92cf60032", "tag": "96a958c7-90e8-46ed-acee-811775e7c8bf"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:53:18.700320 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b26a82d6-c0d7-402a-9a87-619cdc21b6ad tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1267 microversion: 2.1 time: 0.180176 Jun 14 19:53:18.701441 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 497/1011] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:18 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:18.720668 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-3cc90f5e-8ecb-4b60-a035-7c73b8219dbb req-4a8aa27b-7a26-4d69-8b4b-8706a5906172 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:18.721110 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-3cc90f5e-8ecb-4b60-a035-7c73b8219dbb req-4a8aa27b-7a26-4d69-8b4b-8706a5906172 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:18.734261 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-3cc90f5e-8ecb-4b60-a035-7c73b8219dbb req-4a8aa27b-7a26-4d69-8b4b-8706a5906172 service nova] Creating event network-changed:96a958c7-90e8-46ed-acee-811775e7c8bf for instance fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 on hv-cinder-84580 Jun 14 19:53:18.739609 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-3cc90f5e-8ecb-4b60-a035-7c73b8219dbb req-4a8aa27b-7a26-4d69-8b4b-8706a5906172 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050906 Jun 14 19:53:18.740770 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 515/1012] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:53:19.719193 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a9ff0013-a51a-40ae-879e-23c61347fd00 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:19.719809 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a9ff0013-a51a-40ae-879e-23c61347fd00 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:19.726782 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a9ff0013-a51a-40ae-879e-23c61347fd00 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:19.727229 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a9ff0013-a51a-40ae-879e-23c61347fd00 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:19.728014 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a9ff0013-a51a-40ae-879e-23c61347fd00 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:19.728439 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a9ff0013-a51a-40ae-879e-23c61347fd00 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:19.861647 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a9ff0013-a51a-40ae-879e-23c61347fd00 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:19.869119 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a9ff0013-a51a-40ae-879e-23c61347fd00 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1267 microversion: 2.1 time: 0.153802 Jun 14 19:53:19.869720 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 498/1013] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:19 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:20.886970 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-85b7c560-2fa4-4a48-b02d-eee344f9f1ea tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:20.887664 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-85b7c560-2fa4-4a48-b02d-eee344f9f1ea tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:20.894986 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-85b7c560-2fa4-4a48-b02d-eee344f9f1ea tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:20.895373 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-85b7c560-2fa4-4a48-b02d-eee344f9f1ea tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:20.896126 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-85b7c560-2fa4-4a48-b02d-eee344f9f1ea tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:20.896556 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-85b7c560-2fa4-4a48-b02d-eee344f9f1ea tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:21.030101 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-85b7c560-2fa4-4a48-b02d-eee344f9f1ea tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:21.038010 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-85b7c560-2fa4-4a48-b02d-eee344f9f1ea tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1267 microversion: 2.1 time: 0.155733 Jun 14 19:53:21.038569 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 516/1014] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:20 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:22.055240 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-96b41ebf-3f95-4d91-8287-6976bf798c51 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:22.055856 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-96b41ebf-3f95-4d91-8287-6976bf798c51 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:22.062354 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96b41ebf-3f95-4d91-8287-6976bf798c51 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:22.062805 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96b41ebf-3f95-4d91-8287-6976bf798c51 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:22.063563 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96b41ebf-3f95-4d91-8287-6976bf798c51 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:22.064002 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96b41ebf-3f95-4d91-8287-6976bf798c51 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:22.192207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-96b41ebf-3f95-4d91-8287-6976bf798c51 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:22.200391 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-96b41ebf-3f95-4d91-8287-6976bf798c51 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1267 microversion: 2.1 time: 0.149014 Jun 14 19:53:22.200951 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 499/1015] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:22 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:23.217261 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-634199d8-62ef-4068-9e7f-a02b9cc81e5b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:23.217819 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-634199d8-62ef-4068-9e7f-a02b9cc81e5b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:23.224891 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-634199d8-62ef-4068-9e7f-a02b9cc81e5b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:23.225345 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-634199d8-62ef-4068-9e7f-a02b9cc81e5b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:23.226132 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-634199d8-62ef-4068-9e7f-a02b9cc81e5b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:23.226572 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-634199d8-62ef-4068-9e7f-a02b9cc81e5b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:23.353283 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-634199d8-62ef-4068-9e7f-a02b9cc81e5b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:23.360728 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-634199d8-62ef-4068-9e7f-a02b9cc81e5b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1267 microversion: 2.1 time: 0.147420 Jun 14 19:53:23.361291 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 517/1016] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:23 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:24.378565 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-dbe42514-a3a9-4a1c-998e-73e8d9e94cf9 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:24.379173 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-dbe42514-a3a9-4a1c-998e-73e8d9e94cf9 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:24.385623 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dbe42514-a3a9-4a1c-998e-73e8d9e94cf9 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:24.386071 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dbe42514-a3a9-4a1c-998e-73e8d9e94cf9 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:24.386826 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dbe42514-a3a9-4a1c-998e-73e8d9e94cf9 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:24.387259 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-dbe42514-a3a9-4a1c-998e-73e8d9e94cf9 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:24.517224 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-dbe42514-a3a9-4a1c-998e-73e8d9e94cf9 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:24.525540 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-dbe42514-a3a9-4a1c-998e-73e8d9e94cf9 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1267 microversion: 2.1 time: 0.151403 Jun 14 19:53:24.526099 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 500/1017] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:24 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:25.542889 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-ccef3988-1716-447b-9014-dbd1cfcfc0e0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:25.543536 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-ccef3988-1716-447b-9014-dbd1cfcfc0e0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:25.550827 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ccef3988-1716-447b-9014-dbd1cfcfc0e0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:25.551275 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ccef3988-1716-447b-9014-dbd1cfcfc0e0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:25.552038 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ccef3988-1716-447b-9014-dbd1cfcfc0e0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:25.552471 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ccef3988-1716-447b-9014-dbd1cfcfc0e0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:25.681764 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ccef3988-1716-447b-9014-dbd1cfcfc0e0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:25.689077 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-ccef3988-1716-447b-9014-dbd1cfcfc0e0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1267 microversion: 2.1 time: 0.150092 Jun 14 19:53:25.689662 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 518/1018] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:25 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:26.706979 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-42cdf3ad-bfcd-42e6-ac80-f7b4b1c452e4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:26.707716 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-42cdf3ad-bfcd-42e6-ac80-f7b4b1c452e4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:26.710497 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:53:26.715953 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-42cdf3ad-bfcd-42e6-ac80-f7b4b1c452e4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:26.716405 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-42cdf3ad-bfcd-42e6-ac80-f7b4b1c452e4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:26.717167 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-42cdf3ad-bfcd-42e6-ac80-f7b4b1c452e4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:26.717632 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-42cdf3ad-bfcd-42e6-ac80-f7b4b1c452e4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:26.847586 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-42cdf3ad-bfcd-42e6-ac80-f7b4b1c452e4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:26.856008 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-42cdf3ad-bfcd-42e6-ac80-f7b4b1c452e4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1267 microversion: 2.1 time: 0.153791 Jun 14 19:53:26.856572 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 501/1019] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:26 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:27.873432 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-1c2f79de-43b5-49ec-865e-342adeeff26f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:27.874074 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-1c2f79de-43b5-49ec-865e-342adeeff26f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:27.876022 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:53:27.876853 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=6 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:53:27.883392 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1c2f79de-43b5-49ec-865e-342adeeff26f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:27.883841 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1c2f79de-43b5-49ec-865e-342adeeff26f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:27.884601 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1c2f79de-43b5-49ec-865e-342adeeff26f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:27.885033 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-1c2f79de-43b5-49ec-865e-342adeeff26f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:28.020156 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-1c2f79de-43b5-49ec-865e-342adeeff26f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:28.027488 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-1c2f79de-43b5-49ec-865e-342adeeff26f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1267 microversion: 2.1 time: 0.157970 Jun 14 19:53:28.028041 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 519/1020] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:27 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:29.044589 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-73b8f248-2e64-43ad-9ea4-efb0b48f7ef0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:29.045249 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-73b8f248-2e64-43ad-9ea4-efb0b48f7ef0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:29.052509 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-73b8f248-2e64-43ad-9ea4-efb0b48f7ef0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:29.052962 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-73b8f248-2e64-43ad-9ea4-efb0b48f7ef0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:29.053769 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-73b8f248-2e64-43ad-9ea4-efb0b48f7ef0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:29.054207 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-73b8f248-2e64-43ad-9ea4-efb0b48f7ef0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:29.184965 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-73b8f248-2e64-43ad-9ea4-efb0b48f7ef0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:29.192351 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-73b8f248-2e64-43ad-9ea4-efb0b48f7ef0 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1267 microversion: 2.1 time: 0.151710 Jun 14 19:53:29.192914 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 502/1021] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:29 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:30.209322 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-5925c8b3-2aab-4140-8fbb-c4c6d72b5956 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:30.209911 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-5925c8b3-2aab-4140-8fbb-c4c6d72b5956 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:30.216267 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5925c8b3-2aab-4140-8fbb-c4c6d72b5956 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:30.216710 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5925c8b3-2aab-4140-8fbb-c4c6d72b5956 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:30.217489 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5925c8b3-2aab-4140-8fbb-c4c6d72b5956 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:30.217920 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-5925c8b3-2aab-4140-8fbb-c4c6d72b5956 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:30.346020 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-5925c8b3-2aab-4140-8fbb-c4c6d72b5956 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:30.353333 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-5925c8b3-2aab-4140-8fbb-c4c6d72b5956 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1267 microversion: 2.1 time: 0.148475 Jun 14 19:53:30.353913 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 520/1022] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:30 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:30.649305 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-86db17d9-cf88-4259-8f8b-05207109dcdd req-e01a7d4c-517a-49d4-bf42-147e20b03a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf1d80b-9c9d-4f0f-9d08-53d92cf60032", "name": "network-vif-plugged", "status": "completed", "tag": "96a958c7-90e8-46ed-acee-811775e7c8bf"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:53:30.658127 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-86db17d9-cf88-4259-8f8b-05207109dcdd req-e01a7d4c-517a-49d4-bf42-147e20b03a13 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:30.658571 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-86db17d9-cf88-4259-8f8b-05207109dcdd req-e01a7d4c-517a-49d4-bf42-147e20b03a13 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:30.670258 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-86db17d9-cf88-4259-8f8b-05207109dcdd req-e01a7d4c-517a-49d4-bf42-147e20b03a13 service nova] Creating event network-vif-plugged:96a958c7-90e8-46ed-acee-811775e7c8bf for instance fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 on hv-cinder-84580 Jun 14 19:53:30.675182 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-86db17d9-cf88-4259-8f8b-05207109dcdd req-e01a7d4c-517a-49d4-bf42-147e20b03a13 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092582 Jun 14 19:53:30.675759 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 503/1023] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:53:31.370679 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-7058ee99-26c5-4007-b3e5-df4cf9077c66 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:31.371280 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-7058ee99-26c5-4007-b3e5-df4cf9077c66 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:31.377758 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7058ee99-26c5-4007-b3e5-df4cf9077c66 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:31.378207 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7058ee99-26c5-4007-b3e5-df4cf9077c66 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:31.378965 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7058ee99-26c5-4007-b3e5-df4cf9077c66 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:31.379454 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-7058ee99-26c5-4007-b3e5-df4cf9077c66 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:31.506314 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-7058ee99-26c5-4007-b3e5-df4cf9077c66 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:31.513792 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-7058ee99-26c5-4007-b3e5-df4cf9077c66 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1267 microversion: 2.1 time: 0.147275 Jun 14 19:53:31.514345 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 521/1024] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:31 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:32.532493 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a962e7d2-ba6b-4e4f-beef-abc8a1735df1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:32.533109 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a962e7d2-ba6b-4e4f-beef-abc8a1735df1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:32.540396 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a962e7d2-ba6b-4e4f-beef-abc8a1735df1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:32.540844 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a962e7d2-ba6b-4e4f-beef-abc8a1735df1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:32.541630 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a962e7d2-ba6b-4e4f-beef-abc8a1735df1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:32.542068 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a962e7d2-ba6b-4e4f-beef-abc8a1735df1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:32.672194 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a962e7d2-ba6b-4e4f-beef-abc8a1735df1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:32.679936 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a962e7d2-ba6b-4e4f-beef-abc8a1735df1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1453 microversion: 2.1 time: 0.152299 Jun 14 19:53:32.680501 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 504/1025] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:32 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:32.695682 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-79496f83-1ef0-43d0-8512-9d5c390039dc tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:53:32.696275 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-79496f83-1ef0-43d0-8512-9d5c390039dc tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:53:32.702638 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-79496f83-1ef0-43d0-8512-9d5c390039dc tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:32.703083 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-79496f83-1ef0-43d0-8512-9d5c390039dc tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:32.703840 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-79496f83-1ef0-43d0-8512-9d5c390039dc tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:32.704277 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-79496f83-1ef0-43d0-8512-9d5c390039dc tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:32.840396 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-79496f83-1ef0-43d0-8512-9d5c390039dc tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:53:32.847786 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-79496f83-1ef0-43d0-8512-9d5c390039dc tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1453 microversion: 2.1 time: 0.155939 Jun 14 19:53:32.848380 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 522/1026] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:53:32 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:53:34.645452 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-b748fc07-9477-4b03-a01b-1048f6e38837 req-1f20f3e0-dfb4-4fbf-977c-0fae70d1b8ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf1d80b-9c9d-4f0f-9d08-53d92cf60032", "tag": "96a958c7-90e8-46ed-acee-811775e7c8bf"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:53:34.654295 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-b748fc07-9477-4b03-a01b-1048f6e38837 req-1f20f3e0-dfb4-4fbf-977c-0fae70d1b8ac service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:53:34.654731 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-b748fc07-9477-4b03-a01b-1048f6e38837 req-1f20f3e0-dfb4-4fbf-977c-0fae70d1b8ac service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:53:34.666382 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-b748fc07-9477-4b03-a01b-1048f6e38837 req-1f20f3e0-dfb4-4fbf-977c-0fae70d1b8ac service nova] Creating event network-changed:96a958c7-90e8-46ed-acee-811775e7c8bf for instance fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 on hv-cinder-84580 Jun 14 19:53:34.671315 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-b748fc07-9477-4b03-a01b-1048f6e38837 req-1f20f3e0-dfb4-4fbf-977c-0fae70d1b8ac service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029730 Jun 14 19:53:34.672134 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 505/1027] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:53:37.888042 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 19:53:37.888606 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Tue Jun 14 19:53:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 19:55:08.721719 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:55:08.722539 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:55:08.726614 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-821099156", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1706851958", "security_groups": [{"name": "tempest-secgroup-smoke-1919502732"}], "block_device_mapping_v2": [{"uuid": "c5410c73-77a1-46b2-a492-f5406049175a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5f9bd32b-81b7-4de4-b011-9decc2484677"}]}} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:55:08.843416 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.network.neutron [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] validate_networks() for [('5f9bd32b-81b7-4de4-b011-9decc2484677', None, None, None, None, None)] {{(pid=124068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 19:55:09.282945 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Flavor limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 19:55:09.283371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Image limits 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 19:55:09.283841 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Flavor pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 19:55:09.284247 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Image pref 0:0:0 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 19:55:09.284655 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.virt.hardware [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 19:55:09.294728 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:09.295212 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:09.296009 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:09.296441 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:09.314139 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Getting quotas for project b0b8f372dfc54511a3f8c77baaa4f39a. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 19:55:09.318097 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.quota [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Getting quotas for user 10f209080b9745d0a13f60ce5e1ca7df and project b0b8f372dfc54511a3f8c77baaa4f39a. Resources: {'instances', 'ram', 'cores'} {{(pid=124068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 19:55:09.377274 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Going to run 1 instances... {{(pid=124068) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 19:55:09.379382 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c5410c73-77a1-46b2-a492-f5406049175a',volume_size=None,volume_type=None)] {{(pid=124068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 19:55:09.509771 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9b9e59e1-bdd9-4960-b9d0-1107f5c1aaa5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.789169 Jun 14 19:55:09.510417 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 523/1028] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 14 19:55:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 19:55:09.518565 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=28 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:55:09.519712 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=60 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:55:09.524296 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-57a8887f-7cdf-4a1d-93c8-4181dab3658c tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:55:09.525666 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-57a8887f-7cdf-4a1d-93c8-4181dab3658c tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:55:09.603781 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-57a8887f-7cdf-4a1d-93c8-4181dab3658c tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:55:09.613488 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-57a8887f-7cdf-4a1d-93c8-4181dab3658c tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1094 microversion: 2.1 time: 0.096734 Jun 14 19:55:09.614056 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 506/1029] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:55:09 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1094 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:55:10.631378 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-18bf60fb-3a6c-435b-80b7-488f10fdc4b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:55:10.632696 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-18bf60fb-3a6c-435b-80b7-488f10fdc4b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:55:10.641336 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-18bf60fb-3a6c-435b-80b7-488f10fdc4b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:10.641826 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-18bf60fb-3a6c-435b-80b7-488f10fdc4b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:10.642660 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-18bf60fb-3a6c-435b-80b7-488f10fdc4b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:10.643098 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-18bf60fb-3a6c-435b-80b7-488f10fdc4b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:10.733240 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-18bf60fb-3a6c-435b-80b7-488f10fdc4b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:55:10.740634 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-18bf60fb-3a6c-435b-80b7-488f10fdc4b6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1210 microversion: 2.1 time: 0.113040 Jun 14 19:55:10.741200 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 524/1030] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:55:10 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1210 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:55:11.757971 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-a24f9e87-5d35-49ee-8301-4741e0ff9f9a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:55:11.758578 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-a24f9e87-5d35-49ee-8301-4741e0ff9f9a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:55:11.769310 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a24f9e87-5d35-49ee-8301-4741e0ff9f9a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:11.770014 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a24f9e87-5d35-49ee-8301-4741e0ff9f9a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:11.771386 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a24f9e87-5d35-49ee-8301-4741e0ff9f9a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:11.771816 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-a24f9e87-5d35-49ee-8301-4741e0ff9f9a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:11.872995 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [req-74c803ab-1207-4681-8a88-ab1b6484d877 req-c8bc5d50-60fd-44ae-80dc-48de15a056fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e626cdda-ec2c-44ea-87c2-bd6970936e88", "tag": "f26ce71e-f5d3-40ed-b85f-dc1f1d38b0b3"}]} {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:55:11.886591 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-74c803ab-1207-4681-8a88-ab1b6484d877 req-c8bc5d50-60fd-44ae-80dc-48de15a056fd service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:11.887036 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [req-74c803ab-1207-4681-8a88-ab1b6484d877 req-c8bc5d50-60fd-44ae-80dc-48de15a056fd service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:11.899987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.compute.server_external_events [req-74c803ab-1207-4681-8a88-ab1b6484d877 req-c8bc5d50-60fd-44ae-80dc-48de15a056fd service nova] Creating event network-changed:f26ce71e-f5d3-40ed-b85f-dc1f1d38b0b3 for instance e626cdda-ec2c-44ea-87c2-bd6970936e88 on hv-cinder-84580 Jun 14 19:55:11.905293 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [req-74c803ab-1207-4681-8a88-ab1b6484d877 req-c8bc5d50-60fd-44ae-80dc-48de15a056fd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036698 Jun 14 19:55:11.906150 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 525/1031] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 19:55:11.938116 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-a24f9e87-5d35-49ee-8301-4741e0ff9f9a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:55:11.948419 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-a24f9e87-5d35-49ee-8301-4741e0ff9f9a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1266 microversion: 2.1 time: 0.194138 Jun 14 19:55:11.949005 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 507/1032] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:55:11 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:55:12.966430 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-94c58e3e-72aa-41ce-835b-dce0d6f4c133 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:55:12.968076 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-94c58e3e-72aa-41ce-835b-dce0d6f4c133 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:55:12.974380 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-94c58e3e-72aa-41ce-835b-dce0d6f4c133 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:12.974831 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-94c58e3e-72aa-41ce-835b-dce0d6f4c133 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:12.975596 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-94c58e3e-72aa-41ce-835b-dce0d6f4c133 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:12.976030 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-94c58e3e-72aa-41ce-835b-dce0d6f4c133 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:13.107392 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-94c58e3e-72aa-41ce-835b-dce0d6f4c133 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:55:13.114724 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-94c58e3e-72aa-41ce-835b-dce0d6f4c133 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1266 microversion: 2.1 time: 0.153410 Jun 14 19:55:13.115286 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 526/1033] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:55:12 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:55:14.132148 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-81801287-1c65-4596-8c07-164cdb6fc99f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:55:14.132704 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-81801287-1c65-4596-8c07-164cdb6fc99f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:55:14.139817 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-81801287-1c65-4596-8c07-164cdb6fc99f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:14.140271 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-81801287-1c65-4596-8c07-164cdb6fc99f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:14.141030 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-81801287-1c65-4596-8c07-164cdb6fc99f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:14.141493 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-81801287-1c65-4596-8c07-164cdb6fc99f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:14.276649 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-81801287-1c65-4596-8c07-164cdb6fc99f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:55:14.284016 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-81801287-1c65-4596-8c07-164cdb6fc99f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1266 microversion: 2.1 time: 0.155912 Jun 14 19:55:14.284564 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 508/1034] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:55:14 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:55:15.300625 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-c21ba123-be65-4077-b2ba-6182a21a8e23 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:55:15.301238 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-c21ba123-be65-4077-b2ba-6182a21a8e23 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:55:15.307764 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c21ba123-be65-4077-b2ba-6182a21a8e23 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:15.308221 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c21ba123-be65-4077-b2ba-6182a21a8e23 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:15.308987 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c21ba123-be65-4077-b2ba-6182a21a8e23 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:15.309449 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-c21ba123-be65-4077-b2ba-6182a21a8e23 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:15.441536 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-c21ba123-be65-4077-b2ba-6182a21a8e23 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:55:15.448952 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-c21ba123-be65-4077-b2ba-6182a21a8e23 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1266 microversion: 2.1 time: 0.152199 Jun 14 19:55:15.449536 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 527/1035] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:55:15 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:55:16.466447 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-d2ea304c-3210-4ee2-a84c-cff6015cfee1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:55:16.467088 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-d2ea304c-3210-4ee2-a84c-cff6015cfee1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:55:16.473575 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d2ea304c-3210-4ee2-a84c-cff6015cfee1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:16.474027 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d2ea304c-3210-4ee2-a84c-cff6015cfee1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:16.474785 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d2ea304c-3210-4ee2-a84c-cff6015cfee1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:16.475219 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-d2ea304c-3210-4ee2-a84c-cff6015cfee1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:16.606403 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-d2ea304c-3210-4ee2-a84c-cff6015cfee1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:55:16.613755 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-d2ea304c-3210-4ee2-a84c-cff6015cfee1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1266 microversion: 2.1 time: 0.151906 Jun 14 19:55:16.614319 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 509/1036] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:55:16 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:55:17.631052 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-dd54772a-9ea1-48d8-b38c-e3e56a0b96de tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:55:17.631641 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-dd54772a-9ea1-48d8-b38c-e3e56a0b96de tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:55:17.638337 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dd54772a-9ea1-48d8-b38c-e3e56a0b96de tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:17.638784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dd54772a-9ea1-48d8-b38c-e3e56a0b96de tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:17.639545 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dd54772a-9ea1-48d8-b38c-e3e56a0b96de tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:17.639979 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-dd54772a-9ea1-48d8-b38c-e3e56a0b96de tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:17.768804 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-dd54772a-9ea1-48d8-b38c-e3e56a0b96de tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:55:17.777190 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-dd54772a-9ea1-48d8-b38c-e3e56a0b96de tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1266 microversion: 2.1 time: 0.149962 Jun 14 19:55:17.777790 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 528/1037] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:55:17 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:55:18.851547 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-817a2d7c-a903-4469-b6d9-26d2c0bf9c18 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:55:18.852167 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-817a2d7c-a903-4469-b6d9-26d2c0bf9c18 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:55:18.858328 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-817a2d7c-a903-4469-b6d9-26d2c0bf9c18 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:18.858791 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-817a2d7c-a903-4469-b6d9-26d2c0bf9c18 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:18.859550 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-817a2d7c-a903-4469-b6d9-26d2c0bf9c18 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:18.859989 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-817a2d7c-a903-4469-b6d9-26d2c0bf9c18 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:18.994510 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-817a2d7c-a903-4469-b6d9-26d2c0bf9c18 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:55:19.002365 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-817a2d7c-a903-4469-b6d9-26d2c0bf9c18 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1266 microversion: 2.1 time: 0.212241 Jun 14 19:55:19.002932 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 510/1038] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:55:18 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:55:19.663924 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 19:55:19.664374 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Tue Jun 14 19:55:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 19:55:20.019440 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-747337ba-be63-4995-a40d-77ba3737f1b4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:55:20.020052 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-747337ba-be63-4995-a40d-77ba3737f1b4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:55:20.022621 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=2 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:55:20.023309 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell0:SELECT=6 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:55:20.028928 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-747337ba-be63-4995-a40d-77ba3737f1b4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:20.029396 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-747337ba-be63-4995-a40d-77ba3737f1b4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:20.030159 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-747337ba-be63-4995-a40d-77ba3737f1b4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:20.030592 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-747337ba-be63-4995-a40d-77ba3737f1b4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:20.413362 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-747337ba-be63-4995-a40d-77ba3737f1b4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:55:20.421411 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-747337ba-be63-4995-a40d-77ba3737f1b4 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1266 microversion: 2.1 time: 0.405848 Jun 14 19:55:20.421957 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 529/1039] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:55:20 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1266 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:55:21.438352 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-c25a4803-0062-4993-af44-90010846fb12 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:55:21.438969 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-c25a4803-0062-4993-af44-90010846fb12 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:55:21.440922 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell0:SELECT=2 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:55:21.446862 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c25a4803-0062-4993-af44-90010846fb12 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:21.447388 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c25a4803-0062-4993-af44-90010846fb12 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:21.448180 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c25a4803-0062-4993-af44-90010846fb12 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:21.448613 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-c25a4803-0062-4993-af44-90010846fb12 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:21.579519 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-c25a4803-0062-4993-af44-90010846fb12 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:55:21.586950 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-c25a4803-0062-4993-af44-90010846fb12 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1266 microversion: 2.1 time: 0.152441 Jun 14 19:55:21.588135 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 511/1040] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:55:21 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:55:22.604900 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-ee890c77-776e-4916-b90b-94d9d462fd44 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:55:22.605470 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-ee890c77-776e-4916-b90b-94d9d462fd44 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:55:22.611954 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ee890c77-776e-4916-b90b-94d9d462fd44 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:22.612406 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ee890c77-776e-4916-b90b-94d9d462fd44 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:22.613172 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ee890c77-776e-4916-b90b-94d9d462fd44 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:22.613643 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-ee890c77-776e-4916-b90b-94d9d462fd44 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:22.740712 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-ee890c77-776e-4916-b90b-94d9d462fd44 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:55:22.748186 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-ee890c77-776e-4916-b90b-94d9d462fd44 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1266 microversion: 2.1 time: 0.147893 Jun 14 19:55:22.748744 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 530/1041] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:55:22 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:55:23.151040 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-66d1a356-881c-42cd-949b-91fee9ea5594 req-410364ba-8c1e-4515-89e3-14d8e1253cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e626cdda-ec2c-44ea-87c2-bd6970936e88", "name": "network-vif-plugged", "status": "completed", "tag": "f26ce71e-f5d3-40ed-b85f-dc1f1d38b0b3"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:55:23.160183 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-66d1a356-881c-42cd-949b-91fee9ea5594 req-410364ba-8c1e-4515-89e3-14d8e1253cf9 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:23.160622 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-66d1a356-881c-42cd-949b-91fee9ea5594 req-410364ba-8c1e-4515-89e3-14d8e1253cf9 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:23.171542 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-66d1a356-881c-42cd-949b-91fee9ea5594 req-410364ba-8c1e-4515-89e3-14d8e1253cf9 service nova] Creating event network-vif-plugged:f26ce71e-f5d3-40ed-b85f-dc1f1d38b0b3 for instance e626cdda-ec2c-44ea-87c2-bd6970936e88 on hv-cinder-84580 Jun 14 19:55:23.176474 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-66d1a356-881c-42cd-949b-91fee9ea5594 req-410364ba-8c1e-4515-89e3-14d8e1253cf9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029651 Jun 14 19:55:23.177045 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 512/1042] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:55:23.765312 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-d0517359-0d81-4fd7-870b-ed1d3ecf7d7a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:55:23.765954 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-d0517359-0d81-4fd7-870b-ed1d3ecf7d7a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:55:23.772617 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0517359-0d81-4fd7-870b-ed1d3ecf7d7a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:23.773069 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0517359-0d81-4fd7-870b-ed1d3ecf7d7a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:23.773859 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0517359-0d81-4fd7-870b-ed1d3ecf7d7a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:23.774292 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-d0517359-0d81-4fd7-870b-ed1d3ecf7d7a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:23.904526 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-d0517359-0d81-4fd7-870b-ed1d3ecf7d7a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:55:23.911873 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-d0517359-0d81-4fd7-870b-ed1d3ecf7d7a tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1266 microversion: 2.1 time: 0.150433 Jun 14 19:55:23.912426 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 531/1043] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:55:23 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:55:24.930923 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-3b1874aa-8223-4dbe-8c62-4358a5af9c9b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:55:24.931721 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-3b1874aa-8223-4dbe-8c62-4358a5af9c9b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:55:24.937960 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3b1874aa-8223-4dbe-8c62-4358a5af9c9b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:24.938413 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3b1874aa-8223-4dbe-8c62-4358a5af9c9b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:24.939161 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3b1874aa-8223-4dbe-8c62-4358a5af9c9b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:24.939587 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-3b1874aa-8223-4dbe-8c62-4358a5af9c9b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:25.075642 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-3b1874aa-8223-4dbe-8c62-4358a5af9c9b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:55:25.083259 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-3b1874aa-8223-4dbe-8c62-4358a5af9c9b tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1452 microversion: 2.1 time: 0.157005 Jun 14 19:55:25.083820 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 513/1044] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:55:24 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:55:25.100318 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-fe819f8e-9eb0-483b-8b14-fa65a79312a5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:55:25.100933 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-fe819f8e-9eb0-483b-8b14-fa65a79312a5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:55:25.107370 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fe819f8e-9eb0-483b-8b14-fa65a79312a5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:25.107819 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fe819f8e-9eb0-483b-8b14-fa65a79312a5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:25.108588 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fe819f8e-9eb0-483b-8b14-fa65a79312a5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:25.109023 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-fe819f8e-9eb0-483b-8b14-fa65a79312a5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:25.237672 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-fe819f8e-9eb0-483b-8b14-fa65a79312a5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:55:25.245090 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-fe819f8e-9eb0-483b-8b14-fa65a79312a5 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1452 microversion: 2.1 time: 0.148552 Jun 14 19:55:25.245683 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 532/1045] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:55:25 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:55:26.843473 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-13427843-5c3a-4cc8-aa3c-260a15ea175c req-79952875-5679-48a4-805c-e93c7d84d8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e626cdda-ec2c-44ea-87c2-bd6970936e88", "tag": "f26ce71e-f5d3-40ed-b85f-dc1f1d38b0b3"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:55:26.851221 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-13427843-5c3a-4cc8-aa3c-260a15ea175c req-79952875-5679-48a4-805c-e93c7d84d8a0 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:55:26.851656 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-13427843-5c3a-4cc8-aa3c-260a15ea175c req-79952875-5679-48a4-805c-e93c7d84d8a0 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:55:26.863370 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-13427843-5c3a-4cc8-aa3c-260a15ea175c req-79952875-5679-48a4-805c-e93c7d84d8a0 service nova] Creating event network-changed:f26ce71e-f5d3-40ed-b85f-dc1f1d38b0b3 for instance e626cdda-ec2c-44ea-87c2-bd6970936e88 on hv-cinder-84580 Jun 14 19:55:26.868067 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-13427843-5c3a-4cc8-aa3c-260a15ea175c req-79952875-5679-48a4-805c-e93c7d84d8a0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090397 Jun 14 19:55:26.868855 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 514/1046] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:55:32.967667 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 19:55:32.968302 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Tue Jun 14 19:55:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 19:56:57.896125 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 19:56:57.897010 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Tue Jun 14 19:56:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 19:57:06.239504 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:57:06.240678 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG dbcounter [-] [124068] Writing DB stats nova_cell1:SELECT=52 {{(pid=124068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:57:06.242582 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_api:SELECT=20 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:57:06.243584 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG dbcounter [-] [124069] Writing DB stats nova_cell1:SELECT=40 {{(pid=124069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:57:06.244669 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-8790e3ee-1e9b-4d6c-b66c-2aff7938bac1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:57:06.245964 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8790e3ee-1e9b-4d6c-b66c-2aff7938bac1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:57:06.249192 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-545591bb-c9a5-47b4-92e2-fc7d46fb4fa4 req-6f7bfa8b-a57b-41a0-a012-b8388dd4de38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e626cdda-ec2c-44ea-87c2-bd6970936e88", "tag": "f26ce71e-f5d3-40ed-b85f-dc1f1d38b0b3"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:57:06.252994 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8790e3ee-1e9b-4d6c-b66c-2aff7938bac1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:06.253461 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8790e3ee-1e9b-4d6c-b66c-2aff7938bac1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:06.254230 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8790e3ee-1e9b-4d6c-b66c-2aff7938bac1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:06.254658 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-8790e3ee-1e9b-4d6c-b66c-2aff7938bac1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:06.258679 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-545591bb-c9a5-47b4-92e2-fc7d46fb4fa4 req-6f7bfa8b-a57b-41a0-a012-b8388dd4de38 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:06.259123 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-545591bb-c9a5-47b4-92e2-fc7d46fb4fa4 req-6f7bfa8b-a57b-41a0-a012-b8388dd4de38 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:06.270969 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-545591bb-c9a5-47b4-92e2-fc7d46fb4fa4 req-6f7bfa8b-a57b-41a0-a012-b8388dd4de38 service nova] Creating event network-changed:f26ce71e-f5d3-40ed-b85f-dc1f1d38b0b3 for instance e626cdda-ec2c-44ea-87c2-bd6970936e88 on hv-cinder-84580 Jun 14 19:57:06.277006 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-545591bb-c9a5-47b4-92e2-fc7d46fb4fa4 req-6f7bfa8b-a57b-41a0-a012-b8388dd4de38 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036155 Jun 14 19:57:06.278008 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 515/1047] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:57:06.284854 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-8790e3ee-1e9b-4d6c-b66c-2aff7938bac1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Going to try to terminate instance {{(pid=124068) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:57:06.365949 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-8790e3ee-1e9b-4d6c-b66c-2aff7938bac1 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 204 len: 0 microversion: 2.1 time: 0.127670 Jun 14 19:57:06.367196 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 533/1048] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:57:06 2022] DELETE /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:57:06.376195 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-b190a8bc-a4f7-41d7-bfff-7e7aebd8d887 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:57:06.376926 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-b190a8bc-a4f7-41d7-bfff-7e7aebd8d887 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:57:06.383552 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b190a8bc-a4f7-41d7-bfff-7e7aebd8d887 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:06.384029 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b190a8bc-a4f7-41d7-bfff-7e7aebd8d887 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:06.384779 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b190a8bc-a4f7-41d7-bfff-7e7aebd8d887 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:06.385793 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-b190a8bc-a4f7-41d7-bfff-7e7aebd8d887 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:06.539735 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-b190a8bc-a4f7-41d7-bfff-7e7aebd8d887 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:57:06.547922 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-b190a8bc-a4f7-41d7-bfff-7e7aebd8d887 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1577 microversion: 2.1 time: 0.175962 Jun 14 19:57:06.548504 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 516/1049] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:57:06 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:57:07.566347 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-3827f684-c57f-417b-9915-a59450c1fc76 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:57:07.566973 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-3827f684-c57f-417b-9915-a59450c1fc76 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:57:07.573195 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3827f684-c57f-417b-9915-a59450c1fc76 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:07.573673 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3827f684-c57f-417b-9915-a59450c1fc76 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:07.574439 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3827f684-c57f-417b-9915-a59450c1fc76 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:07.574873 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-3827f684-c57f-417b-9915-a59450c1fc76 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:07.791587 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-3827f684-c57f-417b-9915-a59450c1fc76 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:57:07.799063 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-3827f684-c57f-417b-9915-a59450c1fc76 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1577 microversion: 2.1 time: 0.237318 Jun 14 19:57:07.799626 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 534/1050] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:57:07 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1577 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:57:08.369992 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-60718e07-f60b-49fe-9875-183465559d8f req-0b2e3e72-869c-4399-895a-842754c7c9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e626cdda-ec2c-44ea-87c2-bd6970936e88", "name": "network-vif-deleted", "tag": "f26ce71e-f5d3-40ed-b85f-dc1f1d38b0b3"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:57:08.379036 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-60718e07-f60b-49fe-9875-183465559d8f req-0b2e3e72-869c-4399-895a-842754c7c9e4 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:08.379553 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-60718e07-f60b-49fe-9875-183465559d8f req-0b2e3e72-869c-4399-895a-842754c7c9e4 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:08.391795 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-60718e07-f60b-49fe-9875-183465559d8f req-0b2e3e72-869c-4399-895a-842754c7c9e4 service nova] Creating event network-vif-deleted:f26ce71e-f5d3-40ed-b85f-dc1f1d38b0b3 for instance e626cdda-ec2c-44ea-87c2-bd6970936e88 on hv-cinder-84580 Jun 14 19:57:08.396943 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-60718e07-f60b-49fe-9875-183465559d8f req-0b2e3e72-869c-4399-895a-842754c7c9e4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031007 Jun 14 19:57:08.397550 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 517/1051] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:57:08.817401 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-9a2228e8-6feb-4520-adb4-968396eac12f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:57:08.818118 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-9a2228e8-6feb-4520-adb4-968396eac12f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:57:08.825523 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9a2228e8-6feb-4520-adb4-968396eac12f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:08.825971 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9a2228e8-6feb-4520-adb4-968396eac12f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:08.826724 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9a2228e8-6feb-4520-adb4-968396eac12f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:08.827152 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9a2228e8-6feb-4520-adb4-968396eac12f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:08.857014 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9a2228e8-6feb-4520-adb4-968396eac12f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:08.857491 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-9a2228e8-6feb-4520-adb4-968396eac12f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:08.857937 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.objects.instance [None req-9a2228e8-6feb-4520-adb4-968396eac12f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lazy-loading 'fault' on Instance uuid e626cdda-ec2c-44ea-87c2-bd6970936e88 {{(pid=124068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:57:08.901751 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-9a2228e8-6feb-4520-adb4-968396eac12f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:57:08.909062 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-9a2228e8-6feb-4520-adb4-968396eac12f tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 200 len: 1230 microversion: 2.1 time: 0.095552 Jun 14 19:57:08.909739 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 535/1052] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:57:08 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:57:09.927105 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1ce8ca63-7152-46bc-8098-ee7d7f2533a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:57:09.927701 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-1ce8ca63-7152-46bc-8098-ee7d7f2533a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: e626cdda-ec2c-44ea-87c2-bd6970936e88] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:57:09.934082 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1ce8ca63-7152-46bc-8098-ee7d7f2533a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:09.934530 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1ce8ca63-7152-46bc-8098-ee7d7f2533a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:09.935288 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1ce8ca63-7152-46bc-8098-ee7d7f2533a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:09.935749 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1ce8ca63-7152-46bc-8098-ee7d7f2533a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:09.948763 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-1ce8ca63-7152-46bc-8098-ee7d7f2533a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] HTTP exception thrown: Instance e626cdda-ec2c-44ea-87c2-bd6970936e88 could not be found. Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1ce8ca63-7152-46bc-8098-ee7d7f2533a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Request method failure captured: Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 HTTP/1.1 Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOZyIoY1ZBAtkBIvI7FD0gopNgNRbbpxvrFK96SD1NjJ1KnM2ePv3vZ7CtGM2acCsLx9_pM7iNrSJoidRff-NbLFJB3WpoGX9aE4gZuXXpkV4z3_kux8xMylTX8lWD4Wpyo8MRcVuS5Ed1KYaoslvl-UraqH--H88Ldzylpfsr9PBz0 Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: b0b8f372dfc54511a3f8c77baaa4f39a Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-TestVolumeBootPattern-769827167 Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:57:09.950376 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:57:09.952086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b0b8f372dfc54511a3f8c77baaa4f39a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b0b8f372dfc54511a3f8c77baaa4f39a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b0b8f372dfc54511a3f8c77baaa4f39a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b0b8f372dfc54511a3f8c77baaa4f39a"}]}] Jun 14 19:57:09.952086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-TestVolumeBootPattern-769827167 Jun 14 19:57:09.952086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: b0b8f372dfc54511a3f8c77baaa4f39a Jun 14 19:57:09.952086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-TestVolumeBootPattern-769827167 Jun 14 19:57:09.952086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-TestVolumeBootPattern-769827167-project Jun 14 19:57:09.952086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:57:09.952086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:57:09.952086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 10f209080b9745d0a13f60ce5e1ca7df Jun 14 19:57:09.952086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-TestVolumeBootPattern-769827167-project Jun 14 19:57:09.952086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:57:09.952086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance e626cdda-ec2c-44ea-87c2-bd6970936e88 could not be found. Jun 14 19:57:09.952086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': 'e626cdda-ec2c-44ea-87c2-bd6970936e88'} Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e626cdda-ec2c-44ea-87c2-bd6970936e88 could not be found. Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:57:09.953197 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e626cdda-ec2c-44ea-87c2-bd6970936e88 could not be found. Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e626cdda-ec2c-44ea-87c2-bd6970936e88 could not be found. Jun 14 19:57:09.954865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:57:09.956510 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1ce8ca63-7152-46bc-8098-ee7d7f2533a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Returning 404 to user: Instance e626cdda-ec2c-44ea-87c2-bd6970936e88 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:57:09.956510 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-1ce8ca63-7152-46bc-8098-ee7d7f2533a6 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88" status: 404 len: 111 microversion: 2.1 time: 0.029500 Jun 14 19:57:09.956510 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 518/1053] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:57:09 2022] GET /compute/v2.1/servers/e626cdda-ec2c-44ea-87c2-bd6970936e88 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:57:12.991970 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-d5e40399-82fa-46b9-bbee-b8567a8f10ec req-767bef0c-be6e-4368-a6c7-2fe1ee43b569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf1d80b-9c9d-4f0f-9d08-53d92cf60032", "tag": "96a958c7-90e8-46ed-acee-811775e7c8bf"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:57:12.999323 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-eaaa873e-9e86-45eb-97eb-12abbda72703 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:57:12.999841 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-eaaa873e-9e86-45eb-97eb-12abbda72703 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:57:13.006637 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-d5e40399-82fa-46b9-bbee-b8567a8f10ec req-767bef0c-be6e-4368-a6c7-2fe1ee43b569 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:13.006892 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-eaaa873e-9e86-45eb-97eb-12abbda72703 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:13.007076 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-d5e40399-82fa-46b9-bbee-b8567a8f10ec req-767bef0c-be6e-4368-a6c7-2fe1ee43b569 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:13.007602 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-eaaa873e-9e86-45eb-97eb-12abbda72703 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:13.008453 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-eaaa873e-9e86-45eb-97eb-12abbda72703 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:13.008969 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-eaaa873e-9e86-45eb-97eb-12abbda72703 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:13.020691 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-d5e40399-82fa-46b9-bbee-b8567a8f10ec req-767bef0c-be6e-4368-a6c7-2fe1ee43b569 service nova] Creating event network-changed:96a958c7-90e8-46ed-acee-811775e7c8bf for instance fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 on hv-cinder-84580 Jun 14 19:57:13.026633 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-d5e40399-82fa-46b9-bbee-b8567a8f10ec req-767bef0c-be6e-4368-a6c7-2fe1ee43b569 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038085 Jun 14 19:57:13.027403 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 519/1054] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:57:13.035745 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-eaaa873e-9e86-45eb-97eb-12abbda72703 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Going to try to terminate instance {{(pid=124068) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 19:57:13.122341 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-eaaa873e-9e86-45eb-97eb-12abbda72703 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 204 len: 0 microversion: 2.1 time: 0.136815 Jun 14 19:57:13.124109 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 536/1055] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:57:12 2022] DELETE /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 19:57:13.133086 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-cf39ba86-17c4-48f7-8a81-cfaded592330 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:57:13.133938 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-cf39ba86-17c4-48f7-8a81-cfaded592330 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:57:13.141548 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cf39ba86-17c4-48f7-8a81-cfaded592330 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:13.142005 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cf39ba86-17c4-48f7-8a81-cfaded592330 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:13.142773 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cf39ba86-17c4-48f7-8a81-cfaded592330 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:13.143211 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-cf39ba86-17c4-48f7-8a81-cfaded592330 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:13.338849 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.policy [None req-cf39ba86-17c4-48f7-8a81-cfaded592330 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124069) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:57:13.346408 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-cf39ba86-17c4-48f7-8a81-cfaded592330 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1578 microversion: 2.1 time: 0.217631 Jun 14 19:57:13.347047 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 520/1056] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:57:13 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1578 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:57:14.364784 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-21d4d7e2-32f9-498c-845a-d7f833c4be11 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:57:14.365603 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-21d4d7e2-32f9-498c-845a-d7f833c4be11 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:57:14.373255 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-21d4d7e2-32f9-498c-845a-d7f833c4be11 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:14.373797 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-21d4d7e2-32f9-498c-845a-d7f833c4be11 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:14.374587 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-21d4d7e2-32f9-498c-845a-d7f833c4be11 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:14.375021 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-21d4d7e2-32f9-498c-845a-d7f833c4be11 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:14.517306 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-21d4d7e2-32f9-498c-845a-d7f833c4be11 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:57:14.525151 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-21d4d7e2-32f9-498c-845a-d7f833c4be11 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1578 microversion: 2.1 time: 0.164598 Jun 14 19:57:14.535531 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 537/1057] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:57:14 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:57:15.282874 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [req-fa4fbcda-bf4b-420c-b785-f0d2fcf793be req-10b3f31d-3823-4693-b7d9-5838c2210687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf1d80b-9c9d-4f0f-9d08-53d92cf60032", "name": "network-vif-deleted", "tag": "96a958c7-90e8-46ed-acee-811775e7c8bf"}]} {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 19:57:15.292223 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-fa4fbcda-bf4b-420c-b785-f0d2fcf793be req-10b3f31d-3823-4693-b7d9-5838c2210687 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:15.292672 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [req-fa4fbcda-bf4b-420c-b785-f0d2fcf793be req-10b3f31d-3823-4693-b7d9-5838c2210687 service nova] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:15.304266 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.compute.server_external_events [req-fa4fbcda-bf4b-420c-b785-f0d2fcf793be req-10b3f31d-3823-4693-b7d9-5838c2210687 service nova] Creating event network-vif-deleted:96a958c7-90e8-46ed-acee-811775e7c8bf for instance fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 on hv-cinder-84580 Jun 14 19:57:15.309979 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [req-fa4fbcda-bf4b-420c-b785-f0d2fcf793be req-10b3f31d-3823-4693-b7d9-5838c2210687 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030671 Jun 14 19:57:15.310578 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 521/1058] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 14 19:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 19:57:15.545452 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-b80fa26b-af47-452c-b856-baa9d4b14580 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:57:15.546061 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-b80fa26b-af47-452c-b856-baa9d4b14580 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:57:15.552799 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b80fa26b-af47-452c-b856-baa9d4b14580 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:15.553249 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b80fa26b-af47-452c-b856-baa9d4b14580 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:15.554062 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b80fa26b-af47-452c-b856-baa9d4b14580 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:15.554704 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b80fa26b-af47-452c-b856-baa9d4b14580 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:15.594060 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b80fa26b-af47-452c-b856-baa9d4b14580 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:15.594611 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-b80fa26b-af47-452c-b856-baa9d4b14580 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:15.595071 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.objects.instance [None req-b80fa26b-af47-452c-b856-baa9d4b14580 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lazy-loading 'fault' on Instance uuid fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 {{(pid=124068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 19:57:15.641147 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.policy [None req-b80fa26b-af47-452c-b856-baa9d4b14580 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f209080b9745d0a13f60ce5e1ca7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124068) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 19:57:15.649896 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-b80fa26b-af47-452c-b856-baa9d4b14580 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 200 len: 1231 microversion: 2.1 time: 0.108665 Jun 14 19:57:15.651162 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 538/1059] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:57:15 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 1231 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 19:57:16.669736 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-96f02f7b-1b87-4895-b8a2-01d688ab498e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:57:16.670350 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-96f02f7b-1b87-4895-b8a2-01d688ab498e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: fcf1d80b-9c9d-4f0f-9d08-53d92cf60032] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:57:16.676551 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96f02f7b-1b87-4895-b8a2-01d688ab498e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:16.676993 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96f02f7b-1b87-4895-b8a2-01d688ab498e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:16.677781 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96f02f7b-1b87-4895-b8a2-01d688ab498e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:16.678215 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-96f02f7b-1b87-4895-b8a2-01d688ab498e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:16.691846 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-96f02f7b-1b87-4895-b8a2-01d688ab498e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] HTTP exception thrown: Instance fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 could not be found. Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-96f02f7b-1b87-4895-b8a2-01d688ab498e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Request method failure captured: Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 HTTP/1.1 Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOZyIoY1ZBAtkBIvI7FD0gopNgNRbbpxvrFK96SD1NjJ1KnM2ePv3vZ7CtGM2acCsLx9_pM7iNrSJoidRff-NbLFJB3WpoGX9aE4gZuXXpkV4z3_kux8xMylTX8lWD4Wpyo8MRcVuS5Ed1KYaoslvl-UraqH--H88Ldzylpfsr9PBz0 Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: b0b8f372dfc54511a3f8c77baaa4f39a Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-TestVolumeBootPattern-769827167 Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:57:16.693463 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:57:16.695068 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b0b8f372dfc54511a3f8c77baaa4f39a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b0b8f372dfc54511a3f8c77baaa4f39a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b0b8f372dfc54511a3f8c77baaa4f39a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b0b8f372dfc54511a3f8c77baaa4f39a"}]}] Jun 14 19:57:16.695068 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-TestVolumeBootPattern-769827167 Jun 14 19:57:16.695068 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: b0b8f372dfc54511a3f8c77baaa4f39a Jun 14 19:57:16.695068 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-TestVolumeBootPattern-769827167 Jun 14 19:57:16.695068 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-TestVolumeBootPattern-769827167-project Jun 14 19:57:16.695068 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:57:16.695068 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:57:16.695068 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 10f209080b9745d0a13f60ce5e1ca7df Jun 14 19:57:16.695068 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-TestVolumeBootPattern-769827167-project Jun 14 19:57:16.695068 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:57:16.695068 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 could not be found. Jun 14 19:57:16.695068 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': 'fcf1d80b-9c9d-4f0f-9d08-53d92cf60032'} Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 could not be found. Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:57:16.696075 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 could not be found. Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 could not be found. Jun 14 19:57:16.697719 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:57:16.699399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-96f02f7b-1b87-4895-b8a2-01d688ab498e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Returning 404 to user: Instance fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:57:16.699399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-96f02f7b-1b87-4895-b8a2-01d688ab498e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032" status: 404 len: 111 microversion: 2.1 time: 0.030783 Jun 14 19:57:16.699399 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 522/1060] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:57:16 2022] GET /compute/v2.1/servers/fcf1d80b-9c9d-4f0f-9d08-53d92cf60032 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:57:16.966664 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 19:57:16.967413 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Tue Jun 14 19:57:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 19:57:17.137733 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f93d8195-2ffa-4607-a079-99b72fce856d tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:57:17.138238 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.compute.api [None req-f93d8195-2ffa-4607-a079-99b72fce856d tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124068) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:57:17.144840 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f93d8195-2ffa-4607-a079-99b72fce856d tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:17.145326 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f93d8195-2ffa-4607-a079-99b72fce856d tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:17.146112 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f93d8195-2ffa-4607-a079-99b72fce856d tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:17.146542 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG oslo_concurrency.lockutils [None req-f93d8195-2ffa-4607-a079-99b72fce856d tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:17.160021 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.wsgi [None req-f93d8195-2ffa-4607-a079-99b72fce856d tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] HTTP exception thrown: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f93d8195-2ffa-4607-a079-99b72fce856d tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Request method failure captured: Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: request: DELETE /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc HTTP/1.1 Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept: application/json Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Accept-Encoding: identity Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Connection: close Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Length: 0 Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Content-Type: application/json Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Host: 10.222.0.44 Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Openstack-System-Scope: None Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: User-Agent: python-urllib3/1.26.9 Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Auth-Token: gAAAAABiqOZyIoY1ZBAtkBIvI7FD0gopNgNRbbpxvrFK96SD1NjJ1KnM2ePv3vZ7CtGM2acCsLx9_pM7iNrSJoidRff-NbLFJB3WpoGX9aE4gZuXXpkV4z3_kux8xMylTX8lWD4Wpyo8MRcVuS5Ed1KYaoslvl-UraqH--H88Ldzylpfsr9PBz0 Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Id: None Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Domain-Name: None Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Identity-Status: Confirmed Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Is-Admin-Project: True Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Id: default Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Domain-Name: Default Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Id: b0b8f372dfc54511a3f8c77baaa4f39a Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Project-Name: tempest-TestVolumeBootPattern-769827167 Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Role: member,reader Jun 14 19:57:17.161686 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Roles: member,reader Jun 14 19:57:17.163371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b0b8f372dfc54511a3f8c77baaa4f39a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b0b8f372dfc54511a3f8c77baaa4f39a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b0b8f372dfc54511a3f8c77baaa4f39a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b0b8f372dfc54511a3f8c77baaa4f39a"}]}] Jun 14 19:57:17.163371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant: tempest-TestVolumeBootPattern-769827167 Jun 14 19:57:17.163371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Id: b0b8f372dfc54511a3f8c77baaa4f39a Jun 14 19:57:17.163371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-Tenant-Name: tempest-TestVolumeBootPattern-769827167 Jun 14 19:57:17.163371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User: tempest-TestVolumeBootPattern-769827167-project Jun 14 19:57:17.163371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Id: default Jun 14 19:57:17.163371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Domain-Name: Default Jun 14 19:57:17.163371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Id: 10f209080b9745d0a13f60ce5e1ca7df Jun 14 19:57:17.163371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: X-User-Name: tempest-TestVolumeBootPattern-769827167-project Jun 14 19:57:17.163371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: method: > Jun 14 19:57:17.163371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: exception: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. Jun 14 19:57:17.163371 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: action_args: {'id': 'cbde7130-9d05-4c60-bd6d-4b246459c4bc'} Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:57:17.164359 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. Jun 14 19:57:17.165922 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: ERROR nova.api.openstack.wsgi Jun 14 19:57:17.167944 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-f93d8195-2ffa-4607-a079-99b72fce856d tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Returning 404 to user: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. {{(pid=124068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:57:17.167944 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-f93d8195-2ffa-4607-a079-99b72fce856d tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 404 len: 111 microversion: 2.1 time: 0.029907 Jun 14 19:57:17.167944 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 539/1061] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 14 19:57:17 2022] DELETE /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 19:57:17.171769 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1fa5715e-66ac-4037-a991-61b85c54226e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '>' {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:57:17.172383 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.compute.api [None req-1fa5715e-66ac-4037-a991-61b85c54226e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] [instance: cbde7130-9d05-4c60-bd6d-4b246459c4bc] Fetching instance by UUID {{(pid=124069) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 19:57:17.178371 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1fa5715e-66ac-4037-a991-61b85c54226e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:17.178812 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1fa5715e-66ac-4037-a991-61b85c54226e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:17.179575 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1fa5715e-66ac-4037-a991-61b85c54226e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 19:57:17.180010 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG oslo_concurrency.lockutils [None req-1fa5715e-66ac-4037-a991-61b85c54226e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Lock "9f1fc354-1074-4113-b102-f8e074c62626" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 19:57:17.195790 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.wsgi [None req-1fa5715e-66ac-4037-a991-61b85c54226e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] HTTP exception thrown: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1fa5715e-66ac-4037-a991-61b85c54226e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Request method failure captured: Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: request: GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc HTTP/1.1 Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept: application/json Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Accept-Encoding: identity Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Connection: close Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Length: 0 Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Content-Type: application/json Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Host: 10.222.0.44 Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Openstack-System-Scope: None Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: User-Agent: python-urllib3/1.26.9 Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Auth-Token: gAAAAABiqOZyIoY1ZBAtkBIvI7FD0gopNgNRbbpxvrFK96SD1NjJ1KnM2ePv3vZ7CtGM2acCsLx9_pM7iNrSJoidRff-NbLFJB3WpoGX9aE4gZuXXpkV4z3_kux8xMylTX8lWD4Wpyo8MRcVuS5Ed1KYaoslvl-UraqH--H88Ldzylpfsr9PBz0 Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Id: None Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Domain-Name: None Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Identity-Status: Confirmed Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Is-Admin-Project: True Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Id: default Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Domain-Name: Default Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Id: b0b8f372dfc54511a3f8c77baaa4f39a Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Project-Name: tempest-TestVolumeBootPattern-769827167 Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Role: member,reader Jun 14 19:57:17.198108 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Roles: member,reader Jun 14 19:57:17.199744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b0b8f372dfc54511a3f8c77baaa4f39a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b0b8f372dfc54511a3f8c77baaa4f39a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b0b8f372dfc54511a3f8c77baaa4f39a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b0b8f372dfc54511a3f8c77baaa4f39a"}]}] Jun 14 19:57:17.199744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant: tempest-TestVolumeBootPattern-769827167 Jun 14 19:57:17.199744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Id: b0b8f372dfc54511a3f8c77baaa4f39a Jun 14 19:57:17.199744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-Tenant-Name: tempest-TestVolumeBootPattern-769827167 Jun 14 19:57:17.199744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User: tempest-TestVolumeBootPattern-769827167-project Jun 14 19:57:17.199744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Id: default Jun 14 19:57:17.199744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Domain-Name: Default Jun 14 19:57:17.199744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Id: 10f209080b9745d0a13f60ce5e1ca7df Jun 14 19:57:17.199744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: X-User-Name: tempest-TestVolumeBootPattern-769827167-project Jun 14 19:57:17.199744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: method: > Jun 14 19:57:17.199744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: exception: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. Jun 14 19:57:17.199744 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: action_args: {'id': 'cbde7130-9d05-4c60-bd6d-4b246459c4bc'} Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: {{(pid=124069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 19:57:17.200727 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. Jun 14 19:57:17.202331 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: ERROR nova.api.openstack.wsgi Jun 14 19:57:17.203768 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: DEBUG nova.api.openstack.wsgi [None req-1fa5715e-66ac-4037-a991-61b85c54226e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Returning 404 to user: Instance cbde7130-9d05-4c60-bd6d-4b246459c4bc could not be found. {{(pid=124069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 19:57:17.203768 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO nova.api.openstack.requestlog [None req-1fa5715e-66ac-4037-a991-61b85c54226e tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc" status: 404 len: 111 microversion: 2.1 time: 0.031766 Jun 14 19:57:17.203768 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: [pid: 124069|app: 0|req: 523/1062] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 14 19:57:17 2022] GET /compute/v2.1/servers/cbde7130-9d05-4c60-bd6d-4b246459c4bc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 19:57:18.483090 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: DEBUG nova.api.openstack.wsgi [None req-e499564f-3dd4-4120-b382-df89ddfde935 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] Calling method '.version_select at 0x7f144afe8a60>' {{(pid=124068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 19:57:18.504800 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO nova.api.openstack.requestlog [None req-e499564f-3dd4-4120-b382-df89ddfde935 tempest-TestVolumeBootPattern-769827167 tempest-TestVolumeBootPattern-769827167-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1706851958" status: 202 len: 0 microversion: 2.1 time: 0.025961 Jun 14 19:57:18.505805 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: [pid: 124068|app: 0|req: 540/1063] 10.222.0.44 () {58 vars in 1262 bytes} [Tue Jun 14 19:57:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1706851958 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 19:58:52.976309 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 19:58:52.976898 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Tue Jun 14 19:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 20:00:17.904847 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 20:00:17.905474 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Tue Jun 14 20:00:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 20:00:19.674005 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 20:00:19.674605 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Tue Jun 14 20:00:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 20:00:33.281040 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 20:00:33.281732 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Tue Jun 14 20:00:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 20:00:36.975963 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 20:00:36.976475 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Tue Jun 14 20:00:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 20:02:12.984865 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 20:02:12.985430 dv-cinder-845806-1-iscsi devstack@n-api.service[124069]: Tue Jun 14 20:02:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 20:02:26.652685 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 20:02:26.653242 dv-cinder-845806-1-iscsi devstack@n-api.service[124068]: Tue Jun 14 20:02:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!